-- Logs begin at Tue 2022-08-23 15:33:08 UTC, end at Tue 2022-08-23 16:52:30 UTC. -- Aug 23 16:15:00.512485 dv-cinder-850320-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 16:15:00.519791 dv-cinder-850320-6-smb devstack@keystone.service[81497]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 16:15:00 2022] *** Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: nodename: dv-cinder-850320-6-smb Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: machine: x86_64 Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: clock source: unix Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: pcre jit disabled Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: detected number of CPU cores: 4 Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: current working directory: / Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: detected binary path: /usr/bin/uwsgi-core Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: your processes number limit is 47680 Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: your memory page size is 4096 bytes Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: detected max file descriptor number: 2048 Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: lock engine: pthread robust mutexes Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: thunder lock: enabled Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 16:15:00.527288 dv-cinder-850320-6-smb devstack@keystone.service[81497]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 16:15:00.562719 dv-cinder-850320-6-smb devstack@keystone.service[81497]: Python main interpreter initialized at 0x55ef5b4e19c0 Aug 23 16:15:00.562719 dv-cinder-850320-6-smb devstack@keystone.service[81497]: python threads support enabled Aug 23 16:15:00.562719 dv-cinder-850320-6-smb devstack@keystone.service[81497]: your server socket listen backlog is limited to 100 connections Aug 23 16:15:00.562719 dv-cinder-850320-6-smb devstack@keystone.service[81497]: your mercy for graceful operations on workers is 90 seconds Aug 23 16:15:00.563058 dv-cinder-850320-6-smb devstack@keystone.service[81497]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 16:15:00.563136 dv-cinder-850320-6-smb devstack@keystone.service[81497]: *** Operational MODE: preforking *** Aug 23 16:15:00.563415 dv-cinder-850320-6-smb devstack@keystone.service[81497]: *** uWSGI is running in multiple interpreter mode *** Aug 23 16:15:00.563415 dv-cinder-850320-6-smb devstack@keystone.service[81497]: spawned uWSGI master process (pid: 81497) Aug 23 16:15:00.563622 dv-cinder-850320-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 23 16:15:00.564996 dv-cinder-850320-6-smb devstack@keystone.service[81497]: spawned uWSGI worker 1 (pid: 81508, cores: 1) Aug 23 16:15:00.564996 dv-cinder-850320-6-smb devstack@keystone.service[81497]: spawned uWSGI worker 2 (pid: 81509, cores: 1) Aug 23 16:15:00.564996 dv-cinder-850320-6-smb devstack@keystone.service[81497]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 16:15:04.875079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:15:04.875079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: from cryptography.utils import int_from_bytes Aug 23 16:15:04.875890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:15:04.875890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: from cryptography.utils import int_from_bytes Aug 23 16:15:04.876355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:15:04.876355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: from cryptography.utils import int_from_bytes Aug 23 16:15:04.876493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:15:04.876493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: from cryptography.utils import int_from_bytes Aug 23 16:15:04.925583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:15:04.925791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:15:04.925885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:15:04.925982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:15:04.926068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] command line args: [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:15:04.926153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] command line args: [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:15:04.926228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:15:04.926383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:15:04.926477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ================================================================================ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:15:04.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ================================================================================ {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:15:04.926627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] admin_token = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.926813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] admin_token = **** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.926902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] config_dir = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] config_dir = [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] config_source = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] debug = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] config_source = [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] debug = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.927908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.928984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] list_limit = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_config_append = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] log_config_append = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_dir = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] log_dir = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929716 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_file = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] log_file = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.929915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.930962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.931089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.931169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.931288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.931881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.932880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.933000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.933100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.933175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.933291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.933376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.933484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.933840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.933997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] publish_errors = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] publish_errors = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.934921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] standard_threads = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] standard_threads = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.935930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_journal = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_json = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] use_journal = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_stderr = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936552 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] use_json = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] use_syslog = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] use_stderr = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.936913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] use_syslog = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.937049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.937135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:15:04.937287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.937376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.937545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.937638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.937811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.937891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.938061 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.938153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.938300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.938387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.938542 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.938622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.938776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.938865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.939990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.940075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.940222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.940313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.940466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.940547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.940712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.940808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.940945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.941036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.941187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.941273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.941436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.941514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.941706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.941792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.941941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.942022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.942199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.942279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.942437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.942518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.942685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.942771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.942932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.943936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.944092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.944178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.944334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.944418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.944562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.944642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.944790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.944870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945101 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.945994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.946080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.946228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.946308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.946459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.946539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.946688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.946769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.946917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.947606 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.947774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.947858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.947999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.948925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.949072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.949159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.949306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.949386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.949545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.949657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.949808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.956927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.956927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.957964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.958941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.959896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.960976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961601 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.961915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.962998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.963985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.964944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.965956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.external = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] auth.external = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.966923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967101 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.password = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] auth.token = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] auth.password = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967660 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] auth.token = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.967964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.968913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] credential.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969340 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.969991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.970913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] federation.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.971966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.972857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973149 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.973899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.974995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975280 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.975983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.976983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.977092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.977176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.977335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.977426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.977570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.977700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.977840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.977923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.978084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.978258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.978343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.978417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.978594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.978676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.978831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.978921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.979073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.979153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.979303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.979384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.979544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.979633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.979776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.979857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.980965 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.981085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.981204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.981337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.981565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.981664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.981832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.986981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.987965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.988957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.989958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.990997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.991941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.992974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] resource.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.993802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.994412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.994497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.994654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.994737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.994895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.994976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.995131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] role.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.995214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.995376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] role.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.995457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.995607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.995689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.995851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.995933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.996093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] role.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.996173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.996336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.996416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] role.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.996569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.996651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.996812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.996892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.997055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.997137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.997299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.997382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.997544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.997642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.997862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.998021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.998162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.998290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.998416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.998541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.998666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.998792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.998926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.999060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.999060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.999301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.999432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.999561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.999710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.999838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:04.999969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.000101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.000232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.000365 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.000493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.000640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.000768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.000894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.001020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.001159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.001290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.001425 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.001555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.001555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.001848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.002309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.002444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.002573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.002701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.002828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.002958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.003096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.003226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.003354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.003495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.003624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.003751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.003888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.004018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.004147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.004274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.004402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.004530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.004667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.004795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.004923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.005052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.005180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.005371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.005514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.005658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.005785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.005915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] token.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.006045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.006177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.006317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.006447 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.006577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.006707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.006837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.006966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.007113 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.007245 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.007374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.007503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.007632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.007761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.007899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.008029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.008159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.008290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.008418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.008547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.008684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.008812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.008948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.009075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.009199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.009335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.009516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.010189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.010321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.010452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.010581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.010673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.010825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.010899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.010975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.connection = **** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011680 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.011993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.012946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.013022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.013022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:15:05.013156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.013156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.013156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.013358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.013431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.013662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:15:05.013838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:15:05.042791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.043038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.043139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.043222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.043300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.043389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.051622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.051781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.080496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.080725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.081025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.081262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.138631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.138774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.191983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.192123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.192283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.192370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.351651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.351882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.352111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.352335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.352492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.352582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.352732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.352817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.352960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.353712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.353981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.354237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.377089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.377319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.377431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.377548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.377652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.377798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.377892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.378020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.378107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.378237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.378321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.378453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.378546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.378693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.393940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.394042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.406713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.406836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407430 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.407961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.408030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81509) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.408096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:15:05.437367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.437574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:15:05.437689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.437840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:15:05.437944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.438130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:15:05.438214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.438365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:15:05.438448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.438636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.438722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.438894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.439173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.439413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.439513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.439677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.448830 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.449037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.449131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.449321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.449427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.449589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.449707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.449889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.456610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.456915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.459830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.460114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.460398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.460493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.460680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.460790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.460963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.461058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.461221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.461315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.461488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.461583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.461784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.461878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.462113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.462218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.462391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.462486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.463325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.463427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.463605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.463879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.486880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.487331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.488328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.488615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.488807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.489096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.493266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.493549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.493821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.493928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.494114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.494403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.500235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.500525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.500750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.507999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.508082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.508259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.508888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.523692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.523973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.524067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.524325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.528409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.528762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.531704 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.531997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.532084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.532316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.536183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.536559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.539341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.539745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.543129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.543428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.543539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.543711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.543842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.543994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.544132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.544269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.544421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.544555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.544715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.545007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.560428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.560718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.560955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.561039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.561233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.561318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.561517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.561815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.568062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.568699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.569574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.569875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.570247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.570529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.572533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.572816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.573107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.573191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.573397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.573483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.573696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.573786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.574056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.574340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.585035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.588149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.588149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.588298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.588363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.588493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.588618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.588711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.588790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.588866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.588941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.589017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.589017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.589017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.602680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.603790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.606376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.606867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.609237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.609793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.610971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.611499 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.612420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.612704 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.612973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.613056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.613261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.613557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.619554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.620104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.621016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.621568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.624027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.624319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.624534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.624618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.624839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.624924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.625130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.625419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.632889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.633182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.633397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.633483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.633721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.634037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.640489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81509) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.640779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.641059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:15:05.641158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.641268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.641354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.641556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.641662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.641862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.641947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.642141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.642252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.642408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.642521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.642687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.642797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.642958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.643077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.643227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.643335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.643486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.643569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.643770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.643853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.644072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81509) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.644161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.644313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.644579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:15:05.679879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ef5b4e19c0 pid: 81508 (default app) Aug 23 16:15:05.682625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ef5b4e19c0 pid: 81509 (default app) Aug 23 16:15:05.683379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcf0f1-02e4-42a5-a1e2-e2e76a0a5e97 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:05.683671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcf0f1-02e4-42a5-a1e2-e2e76a0a5e97 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:05.683946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcf0f1-02e4-42a5-a1e2-e2e76a0a5e97 None None] PATH_INFO: `/v3` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:05.688103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Tue Aug 23 16:15:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:13.221328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0bad-5ff7-4f98-ba66-4bc242a73548 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:13.221899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0bad-5ff7-4f98-ba66-4bc242a73548 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:13.221899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0bad-5ff7-4f98-ba66-4bc242a73548 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:13.226233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:13.233093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:13.233503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:13.233769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:13.303448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: INFO dbcounter [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] Registered counter for database keystone Aug 23 16:15:13.322523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG oslo_db.sqlalchemy.engines [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:15:13.328599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writer thread running {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:15:13.507444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG passlib.handlers.bcrypt [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81508) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 16:15:13.507852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG passlib.handlers.bcrypt [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81508) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 16:15:13.563438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:13.565072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:13.691610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 16:15:14.177348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0bad-5ff7-4f98-ba66-4bc242a73548 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:14.246360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: INFO dbcounter [None req-9cfa0bad-5ff7-4f98-ba66-4bc242a73548 None None] Registered counter for database keystone Aug 23 16:15:14.268239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG oslo_db.sqlalchemy.engines [None req-9cfa0bad-5ff7-4f98-ba66-4bc242a73548 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:15:14.274419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writer thread running {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:15:14.396293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0bad-5ff7-4f98-ba66-4bc242a73548 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:14.400641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdf588-7bd1-443d-bc33-d1a24d222658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:14.401842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdf588-7bd1-443d-bc33-d1a24d222658 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:14.402124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdf588-7bd1-443d-bc33-d1a24d222658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:14.402395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdf588-7bd1-443d-bc33-d1a24d222658 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:14.410532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdf588-7bd1-443d-bc33-d1a24d222658 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:14.462750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e8bdf588-7bd1-443d-bc33-d1a24d222658 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 16:15:14.463155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdf588-7bd1-443d-bc33-d1a24d222658 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:14.472662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Tue Aug 23 16:15:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:15:14.478873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:14.493589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b921f-11d1-4609-9028-d84c57a1f5e1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:14.498582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ccf3-c7ba-442e-b915-461ffe2a55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:14.499685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ccf3-c7ba-442e-b915-461ffe2a55c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:14.499981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ccf3-c7ba-442e-b915-461ffe2a55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:14.500259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ccf3-c7ba-442e-b915-461ffe2a55c0 admin admin] PATH_INFO: `/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:14.501843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ccf3-c7ba-442e-b915-461ffe2a55c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c2a01d2eee64cb9a559a6d537ff97c8)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:14.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bba4ccf3-c7ba-442e-b915-461ffe2a55c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 16:15:14.554479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ccf3-c7ba-442e-b915-461ffe2a55c0 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:14.559456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Tue Aug 23 16:15:14 2022] GET /identity/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:16.426289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557813-2822-4c29-ad2b-6edba08687b9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:16.426806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557813-2822-4c29-ad2b-6edba08687b9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:16.426946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d557813-2822-4c29-ad2b-6edba08687b9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:16.430971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:16.436227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff9cc-230c-4d8a-8198-f5fb3a272822 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:16.436644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff9cc-230c-4d8a-8198-f5fb3a272822 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:16.436790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff9cc-230c-4d8a-8198-f5fb3a272822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:16.456788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1aeff9cc-230c-4d8a-8198-f5fb3a272822 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:16.458348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1aeff9cc-230c-4d8a-8198-f5fb3a272822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:16.466858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 16:15:16.731954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d557813-2822-4c29-ad2b-6edba08687b9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:16.744128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d557813-2822-4c29-ad2b-6edba08687b9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:16.748815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5cc3b-1513-4715-8a90-e709b98023a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:16.749403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5cc3b-1513-4715-8a90-e709b98023a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:16.749714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5cc3b-1513-4715-8a90-e709b98023a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:16.749994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5cc3b-1513-4715-8a90-e709b98023a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:16.757492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5cc3b-1513-4715-8a90-e709b98023a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:16.759317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5cc3b-1513-4715-8a90-e709b98023a9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:16.768470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Tue Aug 23 16:15:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:15:16.773799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeff9cc-230c-4d8a-8198-f5fb3a272822 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:16.782783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeff9cc-230c-4d8a-8198-f5fb3a272822 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:16.787298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333d743-f267-4270-a065-6494604bd14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:16.787955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d743-f267-4270-a065-6494604bd14d admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:16.788269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d743-f267-4270-a065-6494604bd14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:16.788619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d743-f267-4270-a065-6494604bd14d admin admin] PATH_INFO: `/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:16.789988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d743-f267-4270-a065-6494604bd14d admin admin] RBAC: Authorizing `identity:get_user(user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:16.791803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d743-f267-4270-a065-6494604bd14d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:16.793307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Tue Aug 23 16:15:16 2022] GET /identity/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:18.757089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac7e7-9747-47ef-be39-19b56d6bd31b None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:18.757698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac7e7-9747-47ef-be39-19b56d6bd31b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:18.757698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ac7e7-9747-47ef-be39-19b56d6bd31b None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:18.758987 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:18.764480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9da0-d9fb-414e-8cfe-b64d742ea606 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:18.764947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9da0-d9fb-414e-8cfe-b64d742ea606 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:18.765043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9da0-d9fb-414e-8cfe-b64d742ea606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:18.782480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-325d9da0-d9fb-414e-8cfe-b64d742ea606 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:18.783686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-325d9da0-d9fb-414e-8cfe-b64d742ea606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:18.800168 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76482c04-0be5-4b35-b964-64b2af3d6fb2 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:18.800456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76482c04-0be5-4b35-b964-64b2af3d6fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:18.800731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76482c04-0be5-4b35-b964-64b2af3d6fb2 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:18.802086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:18.807834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:18.808120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:18.808399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:18.849585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG passlib.handlers.bcrypt [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81509) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 16:15:18.850040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG passlib.handlers.bcrypt [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81509) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 16:15:18.862568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:18.896240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:18.897870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:18.995411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:19.132370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d9da0-d9fb-414e-8cfe-b64d742ea606 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.156405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.237670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d9da0-d9fb-414e-8cfe-b64d742ea606 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.265833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.271756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485d767-9d7d-40e3-a902-94ee13fd5616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.272428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485d767-9d7d-40e3-a902-94ee13fd5616 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.272712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485d767-9d7d-40e3-a902-94ee13fd5616 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.272988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485d767-9d7d-40e3-a902-94ee13fd5616 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.284733 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485d767-9d7d-40e3-a902-94ee13fd5616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-6485d767-9d7d-40e3-a902-94ee13fd5616 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:19.293960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:19.295126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:19.296067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:19.300807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485d767-9d7d-40e3-a902-94ee13fd5616 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.368951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae505bc-fb5e-48ac-8616-d56a44bd0bf7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.371930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.383990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.402309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485d767-9d7d-40e3-a902-94ee13fd5616 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.410366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5e9e-f151-403d-b4ed-68849701b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.411672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5e9e-f151-403d-b4ed-68849701b6ce None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.412146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5e9e-f151-403d-b4ed-68849701b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.412512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5e9e-f151-403d-b4ed-68849701b6ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.439520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.442580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.442580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.442580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.442580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:19.442580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.443891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.455704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:19.461178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.485690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5e9e-f151-403d-b4ed-68849701b6ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.487268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5e9e-f151-403d-b4ed-68849701b6ce None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.559081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2703a-e301-45c9-aa6f-9ad1cf66d9a7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.587446 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:15:19.593049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5e9e-f151-403d-b4ed-68849701b6ce None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.595219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dba421-fc66-4e29-a1e7-622ed9de8f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.595774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.595884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba421-fc66-4e29-a1e7-622ed9de8f8c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.596122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba421-fc66-4e29-a1e7-622ed9de8f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.596878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dba421-fc66-4e29-a1e7-622ed9de8f8c None admin] PATH_INFO: `/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.598068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dba421-fc66-4e29-a1e7-622ed9de8f8c None admin] RBAC: Authorizing `identity:get_user(user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.599536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dba421-fc66-4e29-a1e7-622ed9de8f8c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.601083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:19.607150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dba421-fc66-4e29-a1e7-622ed9de8f8c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.623334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.693105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5e9e-f151-403d-b4ed-68849701b6ce None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.706310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dba421-fc66-4e29-a1e7-622ed9de8f8c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.727387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.728249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.728535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.728811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.743679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929277-ddd2-4bb0-8e91-b39883b41167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.744313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929277-ddd2-4bb0-8e91-b39883b41167 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.745136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929277-ddd2-4bb0-8e91-b39883b41167 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.745391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929277-ddd2-4bb0-8e91-b39883b41167 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.746545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8929277-ddd2-4bb0-8e91-b39883b41167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.747989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8929277-ddd2-4bb0-8e91-b39883b41167 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.748570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.749527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 10/18] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:19.750146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.755209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929277-ddd2-4bb0-8e91-b39883b41167 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:19.769540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:19.770780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:19.771595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:19.771595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:19.771595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:19.771595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 9/19] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:19.777513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.835506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.837933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.853528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929277-ddd2-4bb0-8e91-b39883b41167 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.880220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ad2ec-3251-43c3-b23d-03edb1f7a16b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.888281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8df7e1-b569-47da-8ee1-90bde0191f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.888892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df7e1-b569-47da-8ee1-90bde0191f9f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.889177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df7e1-b569-47da-8ee1-90bde0191f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.889459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df7e1-b569-47da-8ee1-90bde0191f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.890215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df7e1-b569-47da-8ee1-90bde0191f9f None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.domain.id=default, user.id=7d0d465dd7b044aba7e2c5ee9fdc6c2c) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:19.890522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df7e1-b569-47da-8ee1-90bde0191f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.891980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df7e1-b569-47da-8ee1-90bde0191f9f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.898472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/role_assignments?user.id=7d0d465dd7b044aba7e2c5ee9fdc6c2c&scope.domain.id=default&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:19.913880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c65c97-12b8-4d1e-8438-e6a0184f9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.914513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c65c97-12b8-4d1e-8438-e6a0184f9b32 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.914795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c65c97-12b8-4d1e-8438-e6a0184f9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.915068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c65c97-12b8-4d1e-8438-e6a0184f9b32 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.915732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c65c97-12b8-4d1e-8438-e6a0184f9b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:19.916030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c65c97-12b8-4d1e-8438-e6a0184f9b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.917496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c65c97-12b8-4d1e-8438-e6a0184f9b32 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.938572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:22.050003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987693e-1916-4ebd-bdf8-cd796d7db719 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.051051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987693e-1916-4ebd-bdf8-cd796d7db719 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.051534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987693e-1916-4ebd-bdf8-cd796d7db719 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.054914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ecd3b-5ae7-452e-9a0a-50280f4f75ee None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.055754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ecd3b-5ae7-452e-9a0a-50280f4f75ee None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.056235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ecd3b-5ae7-452e-9a0a-50280f4f75ee None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.059095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:22.059572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 11/23] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:22.065085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cef01-0909-4454-a20d-7fcd986fd483 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.066578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4629-16ce-423f-b9fa-631b2dca4d4e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.067068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cef01-0909-4454-a20d-7fcd986fd483 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.067557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cef01-0909-4454-a20d-7fcd986fd483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.068057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4629-16ce-423f-b9fa-631b2dca4d4e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.071184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c4629-16ce-423f-b9fa-631b2dca4d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.105803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-c41cef01-0909-4454-a20d-7fcd986fd483 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:22.107030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-425c4629-16ce-423f-b9fa-631b2dca4d4e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:22.108464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c41cef01-0909-4454-a20d-7fcd986fd483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:22.109852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-425c4629-16ce-423f-b9fa-631b2dca4d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:22.251801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 12/24] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:22.270356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 13/25] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:22.741672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4629-16ce-423f-b9fa-631b2dca4d4e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:22.833960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:22.849666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e19f4-7eae-47e4-b387-57bf3b985bb8 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.851704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e19f4-7eae-47e4-b387-57bf3b985bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.852239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e19f4-7eae-47e4-b387-57bf3b985bb8 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.857877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 14/26] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:22.859503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e19f4-7eae-47e4-b387-57bf3b985bb8 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:22.898160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c4629-16ce-423f-b9fa-631b2dca4d4e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:22.936938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57e28-fc5b-4a30-9add-9b5de42fd50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:22.937589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57e28-fc5b-4a30-9add-9b5de42fd50c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.937901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57e28-fc5b-4a30-9add-9b5de42fd50c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.938183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57e28-fc5b-4a30-9add-9b5de42fd50c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.950167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f57e28-fc5b-4a30-9add-9b5de42fd50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:22.951771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f57e28-fc5b-4a30-9add-9b5de42fd50c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-49f57e28-fc5b-4a30-9add-9b5de42fd50c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:22.968361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:22.969281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:22.970143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:22.970143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:22.970143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:22.970143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 13/27] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:22.970822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc973f4-2f95-4fb7-a5bb-366201267a65 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.971333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc973f4-2f95-4fb7-a5bb-366201267a65 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.971799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc973f4-2f95-4fb7-a5bb-366201267a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.986698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:22.993902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0bc973f4-2f95-4fb7-a5bb-366201267a65 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:22.995712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0bc973f4-2f95-4fb7-a5bb-366201267a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:23.021725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e19f4-7eae-47e4-b387-57bf3b985bb8 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.077279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 14/28] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:23.079225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145217-d92d-4930-8b07-e42fee0261c2 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.079730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145217-d92d-4930-8b07-e42fee0261c2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.080239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9145217-d92d-4930-8b07-e42fee0261c2 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.081083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a31dc4-8b33-4c56-9b66-90bdc382efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.081852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31dc4-8b33-4c56-9b66-90bdc382efec None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.082239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31dc4-8b33-4c56-9b66-90bdc382efec None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.082615 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31dc4-8b33-4c56-9b66-90bdc382efec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.082900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 15/29] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:23.083737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9145217-d92d-4930-8b07-e42fee0261c2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.096413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a31dc4-8b33-4c56-9b66-90bdc382efec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-96a31dc4-8b33-4c56-9b66-90bdc382efec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:23.104438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:23.105565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:23.106449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:23.107163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 15/30] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:23.108984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c860-67c3-4220-a2f0-86b99412359d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.109424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c860-67c3-4220-a2f0-86b99412359d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.109876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c860-67c3-4220-a2f0-86b99412359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.127097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:23.132413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2350c860-67c3-4220-a2f0-86b99412359d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:23.133986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2350c860-67c3-4220-a2f0-86b99412359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:23.215920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 16/31] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:23.217205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350c860-67c3-4220-a2f0-86b99412359d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.276146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9145217-d92d-4930-8b07-e42fee0261c2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.290061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:23.319714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.320699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.321185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.321684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.322589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:23.323096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.324684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.338595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 16/32] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:23.341700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350c860-67c3-4220-a2f0-86b99412359d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.344859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.393421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.394075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.394362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.394639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.395319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:23.395625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.397037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.421042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 17/33] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:23.426837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.478147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:23.492317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b1af8-cc1a-4ee5-ba6c-3c20b3a0545b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.530815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f460db-7c1c-452f-909b-f879fda37d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.531382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f460db-7c1c-452f-909b-f879fda37d66 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.531662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f460db-7c1c-452f-909b-f879fda37d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.531949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f460db-7c1c-452f-909b-f879fda37d66 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.532854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f460db-7c1c-452f-909b-f879fda37d66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.534605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f460db-7c1c-452f-909b-f879fda37d66 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.613758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58914-bc71-4b78-affa-ee718bf7ef1a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.664204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:23.672948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4babec-ef04-4f23-b584-2502135e58e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.673650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4babec-ef04-4f23-b584-2502135e58e2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.673943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4babec-ef04-4f23-b584-2502135e58e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.674215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4babec-ef04-4f23-b584-2502135e58e2 None admin] PATH_INFO: `/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.675588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4babec-ef04-4f23-b584-2502135e58e2 None admin] RBAC: Authorizing `identity:get_user(user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.677122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4babec-ef04-4f23-b584-2502135e58e2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.678942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 18/34] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:23 2022] GET /identity/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:23.679460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4babec-ef04-4f23-b584-2502135e58e2 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.755357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 17/35] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:15:23 2022] POST /identity/v3/projects => generated 301 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:23.756512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f460db-7c1c-452f-909b-f879fda37d66 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.786227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4babec-ef04-4f23-b584-2502135e58e2 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.826745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ce275-4372-47b5-b214-a6dd4ae56369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.827363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ce275-4372-47b5-b214-a6dd4ae56369 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.827645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ce275-4372-47b5-b214-a6dd4ae56369 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.829763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ce275-4372-47b5-b214-a6dd4ae56369 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.829763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ce275-4372-47b5-b214-a6dd4ae56369 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.830321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ce275-4372-47b5-b214-a6dd4ae56369 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.891648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f460db-7c1c-452f-909b-f879fda37d66 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.930109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d9ea-ce2d-4e0d-bfce-341402cb7f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.931047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d9ea-ce2d-4e0d-bfce-341402cb7f67 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.931331 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d9ea-ce2d-4e0d-bfce-341402cb7f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.931608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d9ea-ce2d-4e0d-bfce-341402cb7f67 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.932366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024d9ea-ce2d-4e0d-bfce-341402cb7f67 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.933940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024d9ea-ce2d-4e0d-bfce-341402cb7f67 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.013953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.019224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 18/36] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Aug 23 16:15:23 2022] POST /identity/v3/roles => generated 225 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:24.019956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d9ea-ce2d-4e0d-bfce-341402cb7f67 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.071516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 19/37] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Aug 23 16:15:23 2022] POST /identity/v3/roles => generated 219 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:24.071516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99673a-8b18-4512-9a11-94651a061c1d None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.071516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99673a-8b18-4512-9a11-94651a061c1d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.071516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99673a-8b18-4512-9a11-94651a061c1d None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.071516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 20/38] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:24.071516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc097ed-0771-40ad-96e2-76afca7ffe3b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.071516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc097ed-0771-40ad-96e2-76afca7ffe3b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.072164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc097ed-0771-40ad-96e2-76afca7ffe3b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.072164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 21/39] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:24.075041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b3f2-9372-4fdd-b882-a7c041ca7395 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.075299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b3f2-9372-4fdd-b882-a7c041ca7395 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.076241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60b3f2-9372-4fdd-b882-a7c041ca7395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.101029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-9c60b3f2-9372-4fdd-b882-a7c041ca7395 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:24.102912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9c60b3f2-9372-4fdd-b882-a7c041ca7395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:24.154769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d9ea-ce2d-4e0d-bfce-341402cb7f67 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.184411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.207372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 22/40] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:24.209142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248956c-05bc-4e51-9e9d-c1d04f886358 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.209760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248956c-05bc-4e51-9e9d-c1d04f886358 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.210241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248956c-05bc-4e51-9e9d-c1d04f886358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.214798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6c24d-faed-480d-b034-ace2770455cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.215250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c24d-faed-480d-b034-ace2770455cc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.215812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c24d-faed-480d-b034-ace2770455cc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.216166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c24d-faed-480d-b034-ace2770455cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.219670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6c24d-faed-480d-b034-ace2770455cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.222239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6c24d-faed-480d-b034-ace2770455cc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.224009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 19/41] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:24.230993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6c24d-faed-480d-b034-ace2770455cc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.341679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-9248956c-05bc-4e51-9e9d-c1d04f886358 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:24.342095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.343330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9248956c-05bc-4e51-9e9d-c1d04f886358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:24.365729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6c24d-faed-480d-b034-ace2770455cc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.402736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab21c0-8b1b-4b9d-8e21-1c2d6911f90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.403399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab21c0-8b1b-4b9d-8e21-1c2d6911f90b None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.403688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab21c0-8b1b-4b9d-8e21-1c2d6911f90b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.403968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab21c0-8b1b-4b9d-8e21-1c2d6911f90b None admin] PATH_INFO: `/v3/domains/default/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.406178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab21c0-8b1b-4b9d-8e21-1c2d6911f90b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.407617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab21c0-8b1b-4b9d-8e21-1c2d6911f90b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.413420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 23/42] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:24.513939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248956c-05bc-4e51-9e9d-c1d04f886358 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.515699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 20/43] 10.222.0.61 () {58 vars in 1361 bytes} [Tue Aug 23 16:15:24 2022] PUT /identity/v3/domains/default/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:24.624379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248956c-05bc-4e51-9e9d-c1d04f886358 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.639523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.663781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1f67-927d-49e0-bec7-2aa8bde3093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.664660 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1f67-927d-49e0-bec7-2aa8bde3093a None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.665105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1f67-927d-49e0-bec7-2aa8bde3093a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.665548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da1f67-927d-49e0-bec7-2aa8bde3093a None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.666803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da1f67-927d-49e0-bec7-2aa8bde3093a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.668432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da1f67-927d-49e0-bec7-2aa8bde3093a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.685747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab21c0-8b1b-4b9d-8e21-1c2d6911f90b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.750828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 24/44] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Aug 23 16:15:24 2022] POST /identity/v3/roles => generated 223 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:15:24.796044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab21c0-8b1b-4b9d-8e21-1c2d6911f90b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.826640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.835552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480610-31db-4b24-b6fd-46f74edfc1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.836216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480610-31db-4b24-b6fd-46f74edfc1bc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.836501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480610-31db-4b24-b6fd-46f74edfc1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.836779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480610-31db-4b24-b6fd-46f74edfc1bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.837982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480610-31db-4b24-b6fd-46f74edfc1bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.839496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed480610-31db-4b24-b6fd-46f74edfc1bc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.841290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 21/45] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:24.847019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1f67-927d-49e0-bec7-2aa8bde3093a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.961677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da1f67-927d-49e0-bec7-2aa8bde3093a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.995995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95161ca-5136-463e-a7d8-fcd1e0da647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.996611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95161ca-5136-463e-a7d8-fcd1e0da647b None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.996897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95161ca-5136-463e-a7d8-fcd1e0da647b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.997184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95161ca-5136-463e-a7d8-fcd1e0da647b None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.997864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95161ca-5136-463e-a7d8-fcd1e0da647b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.999347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95161ca-5136-463e-a7d8-fcd1e0da647b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:25.081446 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 25/46] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:15:24 2022] POST /identity/v3/projects => generated 312 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:26.430985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa22a-883f-4da6-830f-1caeed6db8b3 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:26.431511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa22a-883f-4da6-830f-1caeed6db8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:26.431599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7aa22a-883f-4da6-830f-1caeed6db8b3 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:26.432926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 22/47] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:26.438155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b702-4e4e-4009-b91d-38c9b9d78939 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:26.438556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b702-4e4e-4009-b91d-38c9b9d78939 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:26.438844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61b702-4e4e-4009-b91d-38c9b9d78939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:26.456477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-5f61b702-4e4e-4009-b91d-38c9b9d78939 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:26.457713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5f61b702-4e4e-4009-b91d-38c9b9d78939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:26.477957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:26.526060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 26/48] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:26.793926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7aa22a-883f-4da6-830f-1caeed6db8b3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:26.894240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7aa22a-883f-4da6-830f-1caeed6db8b3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:26.927423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cd9f3-4caa-4895-a247-492cc725e741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:26.928055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd9f3-4caa-4895-a247-492cc725e741 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:26.928336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd9f3-4caa-4895-a247-492cc725e741 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:26.928607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd9f3-4caa-4895-a247-492cc725e741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:26.939571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cd9f3-4caa-4895-a247-492cc725e741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9d5cd9f3-4caa-4895-a247-492cc725e741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:26.945744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:26.946623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:26.947906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 23/49] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:26.953193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61b702-4e4e-4009-b91d-38c9b9d78939 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:26.965548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850b03-36b0-4d60-b884-e55449876a75 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:26.965874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850b03-36b0-4d60-b884-e55449876a75 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:26.966162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850b03-36b0-4d60-b884-e55449876a75 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:26.967487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 24/50] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:26.972359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66755c2-a815-4bbf-b0e3-a4eec92cc629 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:26.972647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66755c2-a815-4bbf-b0e3-a4eec92cc629 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:26.972922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66755c2-a815-4bbf-b0e3-a4eec92cc629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:26.991254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a66755c2-a815-4bbf-b0e3-a4eec92cc629 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:26.992771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a66755c2-a815-4bbf-b0e3-a4eec92cc629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:27.044092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:27.053170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61b702-4e4e-4009-b91d-38c9b9d78939 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.059935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 25/51] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:27.089167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.089827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.090115 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.090389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.091065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:27.091372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.092773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.100820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 27/52] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:27.106356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66755c2-a815-4bbf-b0e3-a4eec92cc629 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.202535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66755c2-a815-4bbf-b0e3-a4eec92cc629 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.235667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b9c53-bc1f-4467-a2bf-d80604b2bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.236298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b9c53-bc1f-4467-a2bf-d80604b2bec7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.236583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b9c53-bc1f-4467-a2bf-d80604b2bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.236862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b9c53-bc1f-4467-a2bf-d80604b2bec7 None admin] PATH_INFO: `/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.238013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b9c53-bc1f-4467-a2bf-d80604b2bec7 None admin] RBAC: Authorizing `identity:get_user(user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.239461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b9c53-bc1f-4467-a2bf-d80604b2bec7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.241008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:27.247079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.266375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:27.331358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b9c53-bc1f-4467-a2bf-d80604b2bec7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.349133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c06d34-a075-4176-b981-a3c2e64559d0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.383690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef9345-ef31-4cfe-bb18-0819af619750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.384317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef9345-ef31-4cfe-bb18-0819af619750 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.384598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef9345-ef31-4cfe-bb18-0819af619750 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.384872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef9345-ef31-4cfe-bb18-0819af619750 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.386574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef9345-ef31-4cfe-bb18-0819af619750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.388021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef9345-ef31-4cfe-bb18-0819af619750 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.388653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:27.389573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 28/54] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:27.395393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef9345-ef31-4cfe-bb18-0819af619750 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.434779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b9c53-bc1f-4467-a2bf-d80604b2bec7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.467403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438775-613e-42a4-937b-faa09902e381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.468025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438775-613e-42a4-937b-faa09902e381 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.468306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438775-613e-42a4-937b-faa09902e381 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.468580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438775-613e-42a4-937b-faa09902e381 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.469769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64438775-613e-42a4-937b-faa09902e381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.471222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64438775-613e-42a4-937b-faa09902e381 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.472771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:27.478287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438775-613e-42a4-937b-faa09902e381 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.479399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:27.494771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef9345-ef31-4cfe-bb18-0819af619750 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.531671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894efc-b222-408b-a4be-7730c725a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.532295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894efc-b222-408b-a4be-7730c725a675 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.532579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894efc-b222-408b-a4be-7730c725a675 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.532853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894efc-b222-408b-a4be-7730c725a675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.533599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce894efc-b222-408b-a4be-7730c725a675 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.domain.id=default, user.id=7d0d465dd7b044aba7e2c5ee9fdc6c2c) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:27.533937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce894efc-b222-408b-a4be-7730c725a675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.535423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce894efc-b222-408b-a4be-7730c725a675 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.542689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 29/56] 10.222.0.61 () {56 vars in 1322 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/role_assignments?user.id=7d0d465dd7b044aba7e2c5ee9fdc6c2c&scope.domain.id=default&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:27.692569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438775-613e-42a4-937b-faa09902e381 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.716359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:27.727688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3486471-4bd3-44e7-a0a2-9e0c2cf59182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.730488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486471-4bd3-44e7-a0a2-9e0c2cf59182 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.730488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486471-4bd3-44e7-a0a2-9e0c2cf59182 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.730488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486471-4bd3-44e7-a0a2-9e0c2cf59182 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.730488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3486471-4bd3-44e7-a0a2-9e0c2cf59182 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.731029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3486471-4bd3-44e7-a0a2-9e0c2cf59182 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.830162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 28/57] 10.222.0.61 () {60 vars in 1140 bytes} [Tue Aug 23 16:15:27 2022] POST /identity/v3/projects => generated 298 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:15:29.727211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7624-a0d9-429e-9cf6-6de6ec17d76e None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.727761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7624-a0d9-429e-9cf6-6de6ec17d76e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.727761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7624-a0d9-429e-9cf6-6de6ec17d76e None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.729102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 30/58] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:29.734721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994ece-f090-4c7f-a1f0-b6d5f66d62d3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.735127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994ece-f090-4c7f-a1f0-b6d5f66d62d3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.735533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994ece-f090-4c7f-a1f0-b6d5f66d62d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.752848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-74994ece-f090-4c7f-a1f0-b6d5f66d62d3 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:29.754079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-74994ece-f090-4c7f-a1f0-b6d5f66d62d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:29.817370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 29/59] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:30.085186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f7624-a0d9-429e-9cf6-6de6ec17d76e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:30.183279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f7624-a0d9-429e-9cf6-6de6ec17d76e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:30.215397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bb391-6704-4d82-b15d-fb22e959e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:30.216011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bb391-6704-4d82-b15d-fb22e959e105 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:30.216292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bb391-6704-4d82-b15d-fb22e959e105 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:30.216567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bb391-6704-4d82-b15d-fb22e959e105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:30.217672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bb391-6704-4d82-b15d-fb22e959e105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:30.219131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bb391-6704-4d82-b15d-fb22e959e105 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:30.220663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 31/60] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:30.225993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994ece-f090-4c7f-a1f0-b6d5f66d62d3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:30.321192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994ece-f090-4c7f-a1f0-b6d5f66d62d3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:30.324040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:30.353832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bffd0-4599-46a4-8658-8862f44082d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:30.354604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bffd0-4599-46a4-8658-8862f44082d9 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:30.355088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bffd0-4599-46a4-8658-8862f44082d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:30.355706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bffd0-4599-46a4-8658-8862f44082d9 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:30.356429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bffd0-4599-46a4-8658-8862f44082d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:30.357926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bffd0-4599-46a4-8658-8862f44082d9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:30.473590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 30/61] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:15:30 2022] POST /identity/v3/users => generated 275 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:15:33.395258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348cc24-4886-4f8d-9c59-40847d0adc25 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.396279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348cc24-4886-4f8d-9c59-40847d0adc25 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.396772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348cc24-4886-4f8d-9c59-40847d0adc25 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.398627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 32/62] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:33.403580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1648-8290-4c1a-a7e0-992f47af6cba None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.404375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1648-8290-4c1a-a7e0-992f47af6cba None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.404874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1648-8290-4c1a-a7e0-992f47af6cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.430582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-135f1648-8290-4c1a-a7e0-992f47af6cba None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:33.432698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-135f1648-8290-4c1a-a7e0-992f47af6cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:33.523837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 31/63] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:33.530374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b554-8d1b-4e10-ba57-6d4c155a555a None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.531015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b554-8d1b-4e10-ba57-6d4c155a555a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.531509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253b554-8d1b-4e10-ba57-6d4c155a555a None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.533282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 33/64] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:33.538165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6760f6-05d5-49ad-aba0-04d1f230dfe6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.538459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6760f6-05d5-49ad-aba0-04d1f230dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.538743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6760f6-05d5-49ad-aba0-04d1f230dfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.567014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-be6760f6-05d5-49ad-aba0-04d1f230dfe6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:33.568230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-be6760f6-05d5-49ad-aba0-04d1f230dfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:33.662939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 32/65] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:33.814833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253b554-8d1b-4e10-ba57-6d4c155a555a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:33.838621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:33.949739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662850f-be92-4413-868c-52e78e521364 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.950230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662850f-be92-4413-868c-52e78e521364 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.950662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662850f-be92-4413-868c-52e78e521364 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.952382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 33/66] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:33.955445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253b554-8d1b-4e10-ba57-6d4c155a555a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:33.957671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0517b3b-8219-4065-9964-c604c6f46265 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.958104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0517b3b-8219-4065-9964-c604c6f46265 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.958572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0517b3b-8219-4065-9964-c604c6f46265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.995293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f0517b3b-8219-4065-9964-c604c6f46265 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:33.996496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f0517b3b-8219-4065-9964-c604c6f46265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:33.998348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c67a4-4272-40aa-9768-4814912a4543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:33.999043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c67a4-4272-40aa-9768-4814912a4543 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.999335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c67a4-4272-40aa-9768-4814912a4543 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.999608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c67a4-4272-40aa-9768-4814912a4543 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.015950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c67a4-4272-40aa-9768-4814912a4543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-e35c67a4-4272-40aa-9768-4814912a4543 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:34.020860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:34.021773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:34.022537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 34/67] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:34.023190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c67a4-4272-40aa-9768-4814912a4543 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.034454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:34.089678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 34/68] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:34.089678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0517b3b-8219-4065-9964-c604c6f46265 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.132106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:34.162795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c67a4-4272-40aa-9768-4814912a4543 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:34.200124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0517b3b-8219-4065-9964-c604c6f46265 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:34.209868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3fa99-2bb8-48c0-bf8b-50966398da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:34.210378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3fa99-2bb8-48c0-bf8b-50966398da96 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.210666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3fa99-2bb8-48c0-bf8b-50966398da96 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.210945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3fa99-2bb8-48c0-bf8b-50966398da96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.224506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3fa99-2bb8-48c0-bf8b-50966398da96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-95f3fa99-2bb8-48c0-bf8b-50966398da96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:34.231943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:34.233105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:34.234635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 35/69] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:34.235547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465b0e-a41f-486b-8204-c6365d9dece2 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.235844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465b0e-a41f-486b-8204-c6365d9dece2 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.236194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465b0e-a41f-486b-8204-c6365d9dece2 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.237637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 36/70] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:34.238536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25ab43-dfe0-4388-b7fa-fa6086fc0030 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.238820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25ab43-dfe0-4388-b7fa-fa6086fc0030 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.239147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25ab43-dfe0-4388-b7fa-fa6086fc0030 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.240910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fbe8b-74b6-44d2-94b5-98cb6ff39e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:34.241410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 37/71] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:34.241559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fbe8b-74b6-44d2-94b5-98cb6ff39e74 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.242091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fbe8b-74b6-44d2-94b5-98cb6ff39e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.242186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fbe8b-74b6-44d2-94b5-98cb6ff39e74 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.242830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fbe8b-74b6-44d2-94b5-98cb6ff39e74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:34.243141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fbe8b-74b6-44d2-94b5-98cb6ff39e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:34.245157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fbe8b-74b6-44d2-94b5-98cb6ff39e74 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:34.246466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25ab43-dfe0-4388-b7fa-fa6086fc0030 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.258139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 35/72] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:34.264235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f3e0-4453-48f8-b8f8-b9835ab9f03e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.264534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f3e0-4453-48f8-b8f8-b9835ab9f03e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.264822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98f3e0-4453-48f8-b8f8-b9835ab9f03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.283767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bc98f3e0-4453-48f8-b8f8-b9835ab9f03e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:34.285033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bc98f3e0-4453-48f8-b8f8-b9835ab9f03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:34.293841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:34.354401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 36/73] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:34.355930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93029-df73-4498-8319-61f4f5a33096 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.356214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93029-df73-4498-8319-61f4f5a33096 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.356497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93029-df73-4498-8319-61f4f5a33096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.357052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25ab43-dfe0-4388-b7fa-fa6086fc0030 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:34.378148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-40b93029-df73-4498-8319-61f4f5a33096 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:34.379322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-40b93029-df73-4498-8319-61f4f5a33096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:34.396785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:34.397597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.397737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.397964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.398623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] RBAC: Adding query filter params (name=member) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:34.398926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:34.400418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:34.405393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:34.409294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 38/74] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:34.410098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.457689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 37/75] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:34.466544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b93029-df73-4498-8319-61f4f5a33096 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.520808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68dd4d-37bd-4e0e-8553-314f7c724673 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:34.540445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:34.558949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707132-0389-46fe-a9d8-0a2417096d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:34.559948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707132-0389-46fe-a9d8-0a2417096d28 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.560411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707132-0389-46fe-a9d8-0a2417096d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.560865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b707132-0389-46fe-a9d8-0a2417096d28 None admin] PATH_INFO: `/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.562310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b707132-0389-46fe-a9d8-0a2417096d28 None admin] RBAC: Authorizing `identity:get_user(user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:34.564074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b707132-0389-46fe-a9d8-0a2417096d28 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:34.566009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 39/76] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:34.571462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707132-0389-46fe-a9d8-0a2417096d28 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.573246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b93029-df73-4498-8319-61f4f5a33096 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:34.608876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3cb38-f8fc-4990-81bc-cf85666cbda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:34.609646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cb38-f8fc-4990-81bc-cf85666cbda5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.609991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cb38-f8fc-4990-81bc-cf85666cbda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.610602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3cb38-f8fc-4990-81bc-cf85666cbda5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.621298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3cb38-f8fc-4990-81bc-cf85666cbda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c1e3cb38-f8fc-4990-81bc-cf85666cbda5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:34.627498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:34.628553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 38/77] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:34.629586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3cb38-f8fc-4990-81bc-cf85666cbda5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.650259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:34.688471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b707132-0389-46fe-a9d8-0a2417096d28 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:34.723689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3f15c-2893-4895-9e49-2c2a579726fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:34.724241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f15c-2893-4895-9e49-2c2a579726fc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.724525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f15c-2893-4895-9e49-2c2a579726fc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.724799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f15c-2893-4895-9e49-2c2a579726fc None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.732252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3cb38-f8fc-4990-81bc-cf85666cbda5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:34.738431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3f15c-2893-4895-9e49-2c2a579726fc None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:34.739904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3f15c-2893-4895-9e49-2c2a579726fc None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:34.741523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 40/78] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:34.742319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3f15c-2893-4895-9e49-2c2a579726fc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.765437 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:34.770681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b68d3-ea24-4ddc-a242-a2eb10fcd428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:34.771293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b68d3-ea24-4ddc-a242-a2eb10fcd428 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.771572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b68d3-ea24-4ddc-a242-a2eb10fcd428 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.771840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b68d3-ea24-4ddc-a242-a2eb10fcd428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.838858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b68d3-ea24-4ddc-a242-a2eb10fcd428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:34.840310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3f15c-2893-4895-9e49-2c2a579726fc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:34.840414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b68d3-ea24-4ddc-a242-a2eb10fcd428 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:34.865151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:34.874223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c89d26-adc4-44dd-b611-ff5a372910ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:34.874856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c89d26-adc4-44dd-b611-ff5a372910ef None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:34.876907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c89d26-adc4-44dd-b611-ff5a372910ef None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:34.876907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c89d26-adc4-44dd-b611-ff5a372910ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:34.876907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c89d26-adc4-44dd-b611-ff5a372910ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:34.878178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c89d26-adc4-44dd-b611-ff5a372910ef None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:34.879849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 41/79] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:34.884545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c89d26-adc4-44dd-b611-ff5a372910ef None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.948898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 39/80] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:34.949901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b68d3-ea24-4ddc-a242-a2eb10fcd428 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:34.980954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:35.005294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c89d26-adc4-44dd-b611-ff5a372910ef None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.042312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.042929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.043214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.043502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.044171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:35.044477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.045895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.048880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b68d3-ea24-4ddc-a242-a2eb10fcd428 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.053901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 42/81] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:35.057480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.083555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f9cc-d1c4-4656-990c-fd9ee748bd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.084188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f9cc-d1c4-4656-990c-fd9ee748bd36 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.084481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f9cc-d1c4-4656-990c-fd9ee748bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.084755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f9cc-d1c4-4656-990c-fd9ee748bd36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.094737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15f9cc-d1c4-4656-990c-fd9ee748bd36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9a15f9cc-d1c4-4656-990c-fd9ee748bd36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:35.099469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:35.100284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:35.101096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 40/82] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:35.102117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f9cc-d1c4-4656-990c-fd9ee748bd36 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.116570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:35.160138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d3345-945a-4e2e-a9eb-5d0571bca180 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.192848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:35.193642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65218763-aefe-49d7-8c96-cd9521246834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.194258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65218763-aefe-49d7-8c96-cd9521246834 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.194537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65218763-aefe-49d7-8c96-cd9521246834 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.194812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65218763-aefe-49d7-8c96-cd9521246834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.202071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f9cc-d1c4-4656-990c-fd9ee748bd36 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.239455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a749b1-1ae2-4766-8a6c-0fc494d9b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.239987 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a749b1-1ae2-4766-8a6c-0fc494d9b989 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.240269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a749b1-1ae2-4766-8a6c-0fc494d9b989 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.240542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a749b1-1ae2-4766-8a6c-0fc494d9b989 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.241182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a749b1-1ae2-4766-8a6c-0fc494d9b989 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.242682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a749b1-1ae2-4766-8a6c-0fc494d9b989 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.262174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65218763-aefe-49d7-8c96-cd9521246834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.263670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65218763-aefe-49d7-8c96-cd9521246834 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.317077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:35.320762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 41/83] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:15:35 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:35.321632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a749b1-1ae2-4766-8a6c-0fc494d9b989 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.379965 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 43/84] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:35.381200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65218763-aefe-49d7-8c96-cd9521246834 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.439727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a749b1-1ae2-4766-8a6c-0fc494d9b989 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.482217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535e896-f068-44b2-8287-e7c10b7b0473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.482851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535e896-f068-44b2-8287-e7c10b7b0473 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.482851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535e896-f068-44b2-8287-e7c10b7b0473 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.483139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535e896-f068-44b2-8287-e7c10b7b0473 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.484305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535e896-f068-44b2-8287-e7c10b7b0473 None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.486080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535e896-f068-44b2-8287-e7c10b7b0473 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.487714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 42/85] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:35.488485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535e896-f068-44b2-8287-e7c10b7b0473 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.508767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:35.519881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65218763-aefe-49d7-8c96-cd9521246834 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.563314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c272-3491-43a5-b076-b919605659fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.564311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c272-3491-43a5-b076-b919605659fd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.564617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c272-3491-43a5-b076-b919605659fd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.564899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450c272-3491-43a5-b076-b919605659fd None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.566287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c272-3491-43a5-b076-b919605659fd None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.568274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450c272-3491-43a5-b076-b919605659fd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.571335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 44/86] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:35.571335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c272-3491-43a5-b076-b919605659fd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.604180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:35.607985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535e896-f068-44b2-8287-e7c10b7b0473 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.647403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.648013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.648293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.648570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.649242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:35.649538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.651791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.661832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 43/87] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:35.662565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.704727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450c272-3491-43a5-b076-b919605659fd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.756031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31265c80-9ef7-4c85-be5c-66651dea56d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.757121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265c80-9ef7-4c85-be5c-66651dea56d5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.757637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265c80-9ef7-4c85-be5c-66651dea56d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.758125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31265c80-9ef7-4c85-be5c-66651dea56d5 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.759643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31265c80-9ef7-4c85-be5c-66651dea56d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.762542 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31265c80-9ef7-4c85-be5c-66651dea56d5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.765114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:35.776597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 45/88] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:35.778947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31265c80-9ef7-4c85-be5c-66651dea56d5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.801013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58e23-a912-4f37-ba43-b95e8ab9c061 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:35.838921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:35.839560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:35.839845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:35.840120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:35.840858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=e13bb57123f8483b9d6f24c63738d6be, user.id=7d0d465dd7b044aba7e2c5ee9fdc6c2c) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:35.841166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:35.842641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:35.850788 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 44/89] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/role_assignments?user.id=7d0d465dd7b044aba7e2c5ee9fdc6c2c&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:35.851620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:35.941458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:35.958220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31265c80-9ef7-4c85-be5c-66651dea56d5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.018695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0d67b-9006-40d9-8a2e-d9bf51f3dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.019229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0d67b-9006-40d9-8a2e-d9bf51f3dd34 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.019614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0d67b-9006-40d9-8a2e-d9bf51f3dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.019894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0d67b-9006-40d9-8a2e-d9bf51f3dd34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.036287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9cb60-852f-4372-b34c-887b108f2334 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.104157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35443860-989c-4053-82bb-60d14b06b820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.104808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35443860-989c-4053-82bb-60d14b06b820 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.105094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35443860-989c-4053-82bb-60d14b06b820 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.105372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35443860-989c-4053-82bb-60d14b06b820 None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.107512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35443860-989c-4053-82bb-60d14b06b820 None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.109707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35443860-989c-4053-82bb-60d14b06b820 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.114766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 45/90] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:36.115578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35443860-989c-4053-82bb-60d14b06b820 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.129765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0d67b-9006-40d9-8a2e-d9bf51f3dd34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.133893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0d67b-9006-40d9-8a2e-d9bf51f3dd34 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.143648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.266217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35443860-989c-4053-82bb-60d14b06b820 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.302943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.303468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.303751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.304023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.304750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] RBAC: Adding query filter params (role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=e13bb57123f8483b9d6f24c63738d6be, user.id=e585ef5ba4f347e99c8c23cbb6cb501a) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:36.305059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.306548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.307183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.314315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 46/91] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/role_assignments?user.id=e585ef5ba4f347e99c8c23cbb6cb501a&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:36.315148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.328397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 46/92] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:36.335981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0d67b-9006-40d9-8a2e-d9bf51f3dd34 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.440202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.468559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dd66b-3498-47a9-b490-8cdb46bb1343 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.508562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c30f-30ae-49c7-8908-029b16a1e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.509200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c30f-30ae-49c7-8908-029b16a1e965 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.509461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c30f-30ae-49c7-8908-029b16a1e965 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.509834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c30f-30ae-49c7-8908-029b16a1e965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.584676 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0d67b-9006-40d9-8a2e-d9bf51f3dd34 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.587618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663c30f-30ae-49c7-8908-029b16a1e965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.589718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663c30f-30ae-49c7-8908-029b16a1e965 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.658333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b38d4-b0a3-4fbb-86c2-21d4d890128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.658998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b38d4-b0a3-4fbb-86c2-21d4d890128d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.659286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b38d4-b0a3-4fbb-86c2-21d4d890128d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.659565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b38d4-b0a3-4fbb-86c2-21d4d890128d None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.660732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b38d4-b0a3-4fbb-86c2-21d4d890128d None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.662246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b38d4-b0a3-4fbb-86c2-21d4d890128d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.664069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 47/93] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:36.670037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b38d4-b0a3-4fbb-86c2-21d4d890128d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.671347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.701003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 47/94] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:36.706718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c30f-30ae-49c7-8908-029b16a1e965 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.790880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.816842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c30f-30ae-49c7-8908-029b16a1e965 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.855591 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7c97-0571-4f3a-b2dd-330d1ca66ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.856152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7c97-0571-4f3a-b2dd-330d1ca66ecf None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.856434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7c97-0571-4f3a-b2dd-330d1ca66ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.856709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7c97-0571-4f3a-b2dd-330d1ca66ecf None admin] PATH_INFO: `/v3/projects/289aaa840ff34576a72cf57a64b7b24b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.857902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7c97-0571-4f3a-b2dd-330d1ca66ecf None admin] RBAC: Authorizing `identity:get_project(project_id=289aaa840ff34576a72cf57a64b7b24b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.859398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7c97-0571-4f3a-b2dd-330d1ca66ecf None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.861668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 48/95] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/projects/289aaa840ff34576a72cf57a64b7b24b => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:36.868295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7c97-0571-4f3a-b2dd-330d1ca66ecf None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.888431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b38d4-b0a3-4fbb-86c2-21d4d890128d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.915825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.958738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42631c6-b7c3-44cc-8df6-b1bdeb5ec023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.959364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42631c6-b7c3-44cc-8df6-b1bdeb5ec023 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.959654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42631c6-b7c3-44cc-8df6-b1bdeb5ec023 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.959931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42631c6-b7c3-44cc-8df6-b1bdeb5ec023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.960673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42631c6-b7c3-44cc-8df6-b1bdeb5ec023 None admin] RBAC: Adding query filter params (role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=e13bb57123f8483b9d6f24c63738d6be, user.id=e585ef5ba4f347e99c8c23cbb6cb501a) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:36.960986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42631c6-b7c3-44cc-8df6-b1bdeb5ec023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.962480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42631c6-b7c3-44cc-8df6-b1bdeb5ec023 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.973866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 48/96] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/role_assignments?user.id=e585ef5ba4f347e99c8c23cbb6cb501a&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=0e7d21c594094cef90457df82be0bce6 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:36.981129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7c97-0571-4f3a-b2dd-330d1ca66ecf None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:37.020808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16640d4f-f3b9-4c9f-be99-f3d5ff2163d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:37.021424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640d4f-f3b9-4c9f-be99-f3d5ff2163d1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:37.021736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640d4f-f3b9-4c9f-be99-f3d5ff2163d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:37.022010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640d4f-f3b9-4c9f-be99-f3d5ff2163d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:37.022744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16640d4f-f3b9-4c9f-be99-f3d5ff2163d1 None admin] RBAC: Adding query filter params (role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=289aaa840ff34576a72cf57a64b7b24b, user.id=e585ef5ba4f347e99c8c23cbb6cb501a) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:37.023051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16640d4f-f3b9-4c9f-be99-f3d5ff2163d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:37.024525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16640d4f-f3b9-4c9f-be99-f3d5ff2163d1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:37.031015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 49/97] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/role_assignments?user.id=e585ef5ba4f347e99c8c23cbb6cb501a&scope.project.id=289aaa840ff34576a72cf57a64b7b24b&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:37.862704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c980d-8083-4dbd-a513-47a24d8c88c1 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:37.863227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c980d-8083-4dbd-a513-47a24d8c88c1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:37.863299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c980d-8083-4dbd-a513-47a24d8c88c1 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:37.864947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 49/98] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:37.870129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd0f3c-f1f3-4bce-a6b3-0c99a3548ab4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:37.870983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd0f3c-f1f3-4bce-a6b3-0c99a3548ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:37.871521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd0f3c-f1f3-4bce-a6b3-0c99a3548ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:37.898186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-eedd0f3c-f1f3-4bce-a6b3-0c99a3548ab4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:37.899731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-eedd0f3c-f1f3-4bce-a6b3-0c99a3548ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:37.983023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 50/99] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:38.164929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed361-68ba-444e-997b-00d6ef2f041b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.165560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed361-68ba-444e-997b-00d6ef2f041b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.166627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ed361-68ba-444e-997b-00d6ef2f041b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.168422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 50/100] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:38.173534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914e24-f75d-4bd5-8f9a-e196adb9dc43 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.174068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914e24-f75d-4bd5-8f9a-e196adb9dc43 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.174539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914e24-f75d-4bd5-8f9a-e196adb9dc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.202578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-50914e24-f75d-4bd5-8f9a-e196adb9dc43 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:38.204082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-50914e24-f75d-4bd5-8f9a-e196adb9dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:38.238181 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:38.256871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279198e5-d0f9-46a5-8902-9b77ab684c52 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.257171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279198e5-d0f9-46a5-8902-9b77ab684c52 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.257431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279198e5-d0f9-46a5-8902-9b77ab684c52 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.259037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 51/101] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:38.264194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a42ca-8561-4084-9ace-7d0d88019903 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.264484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a42ca-8561-4084-9ace-7d0d88019903 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.264764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a42ca-8561-4084-9ace-7d0d88019903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.283342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1c6a42ca-8561-4084-9ace-7d0d88019903 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:38.284831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1c6a42ca-8561-4084-9ace-7d0d88019903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:38.290428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 51/102] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:38.376147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 52/103] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:38.498439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914e24-f75d-4bd5-8f9a-e196adb9dc43 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.634188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914e24-f75d-4bd5-8f9a-e196adb9dc43 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.680007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3f9b2-acaf-4361-b895-690f0580283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.680645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3f9b2-acaf-4361-b895-690f0580283d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.680924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3f9b2-acaf-4361-b895-690f0580283d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.681194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3f9b2-acaf-4361-b895-690f0580283d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.700395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3f9b2-acaf-4361-b895-690f0580283d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-56b3f9b2-acaf-4361-b895-690f0580283d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:38.705173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:38.706082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:38.706870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 52/104] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:38.711976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a42ca-8561-4084-9ace-7d0d88019903 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.714177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3f9b2-acaf-4361-b895-690f0580283d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.762941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:38.799910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:38.886628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a42ca-8561-4084-9ace-7d0d88019903 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.902143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3f9b2-acaf-4361-b895-690f0580283d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.957487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.958131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.958415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.958694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.961478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:38.961815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:38.963798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:38.977739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4bc3b-03a2-4666-8606-7a8ced881f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.978378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4bc3b-03a2-4666-8606-7a8ced881f03 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.978695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4bc3b-03a2-4666-8606-7a8ced881f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.978975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4bc3b-03a2-4666-8606-7a8ced881f03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.980300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4bc3b-03a2-4666-8606-7a8ced881f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:38.981789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4bc3b-03a2-4666-8606-7a8ced881f03 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:38.983369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 53/105] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:38.990041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 53/106] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:38.990820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4bc3b-03a2-4666-8606-7a8ced881f03 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.992700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:39.163543 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:39.171663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4bc3b-03a2-4666-8606-7a8ced881f03 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:39.176485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf495c-e485-4aee-959e-55aca0f1a614 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:39.209996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:39.231436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdc033-bc66-441f-8f3c-42b015f7d911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:39.232088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdc033-bc66-441f-8f3c-42b015f7d911 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.232368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdc033-bc66-441f-8f3c-42b015f7d911 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.232642 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdc033-bc66-441f-8f3c-42b015f7d911 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.241496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e60ce-d695-4055-9750-af182eaac06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:39.242145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e60ce-d695-4055-9750-af182eaac06a None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.242431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e60ce-d695-4055-9750-af182eaac06a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.242709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e60ce-d695-4055-9750-af182eaac06a None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.243377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e60ce-d695-4055-9750-af182eaac06a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:39.245386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e60ce-d695-4055-9750-af182eaac06a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:39.261909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdc033-bc66-441f-8f3c-42b015f7d911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8ebdc033-bc66-441f-8f3c-42b015f7d911 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:39.266692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:39.267574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:39.268333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 54/107] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:39.269918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdc033-bc66-441f-8f3c-42b015f7d911 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:39.363994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 54/108] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:15:38 2022] POST /identity/v3/projects => generated 302 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:15:39.366133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e60ce-d695-4055-9750-af182eaac06a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:39.415851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdc033-bc66-441f-8f3c-42b015f7d911 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:39.530398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759e85-22d9-4247-a204-1da708e5b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:39.531077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759e85-22d9-4247-a204-1da708e5b47b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.531372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759e85-22d9-4247-a204-1da708e5b47b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.531664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759e85-22d9-4247-a204-1da708e5b47b None admin] PATH_INFO: `/v3/users/c3f1d9acb16f4432af7205dd5f8cb2b0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.568333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a759e85-22d9-4247-a204-1da708e5b47b None admin] RBAC: Authorizing `identity:get_user(user_id=c3f1d9acb16f4432af7205dd5f8cb2b0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:39.569816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a759e85-22d9-4247-a204-1da708e5b47b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:39.571837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 55/109] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:39 2022] GET /identity/v3/users/c3f1d9acb16f4432af7205dd5f8cb2b0 => generated 289 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:39.574354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e60ce-d695-4055-9750-af182eaac06a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:39.578077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759e85-22d9-4247-a204-1da708e5b47b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:39.606681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:39.612833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:39.613751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.614289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.614760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.615623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:39.616140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:39.617846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:39.627698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 55/110] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:39.637824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:39.687177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:39.719451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759e85-22d9-4247-a204-1da708e5b47b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:39.762074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ed938-42a4-4c18-b23d-d3fda9888597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:39.762751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ed938-42a4-4c18-b23d-d3fda9888597 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.763042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ed938-42a4-4c18-b23d-d3fda9888597 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.763324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ed938-42a4-4c18-b23d-d3fda9888597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.787821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfcc2-ac18-46be-9875-01805577502d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:39.844283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81256b70-bda3-4d54-a7b5-d40222eb4d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:39.845168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256b70-bda3-4d54-a7b5-d40222eb4d8b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.845368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ed938-42a4-4c18-b23d-d3fda9888597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:39.845472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256b70-bda3-4d54-a7b5-d40222eb4d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.845764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81256b70-bda3-4d54-a7b5-d40222eb4d8b None admin] PATH_INFO: `/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.846909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ed938-42a4-4c18-b23d-d3fda9888597 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:39.847015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81256b70-bda3-4d54-a7b5-d40222eb4d8b None admin] RBAC: Authorizing `identity:get_user(user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:39.848393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81256b70-bda3-4d54-a7b5-d40222eb4d8b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:39.850536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 56/111] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:39 2022] GET /identity/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:39.851962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a947a-ee6d-4e70-b60d-226e75e78116 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.852254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a947a-ee6d-4e70-b60d-226e75e78116 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.852531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a947a-ee6d-4e70-b60d-226e75e78116 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.854338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 57/112] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:39.855529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475895-6e0a-4a74-9d72-6163729f323d None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.855795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475895-6e0a-4a74-9d72-6163729f323d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.856072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c475895-6e0a-4a74-9d72-6163729f323d None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.857250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 58/113] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:39.864020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c475895-6e0a-4a74-9d72-6163729f323d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:39.873528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:39.965956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 56/114] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:15:39.967242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a3ddb-19be-48a6-a46e-2c65ff038d9b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:39.967530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a3ddb-19be-48a6-a46e-2c65ff038d9b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:39.967804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a3ddb-19be-48a6-a46e-2c65ff038d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:39.978101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:39.983949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c475895-6e0a-4a74-9d72-6163729f323d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:39.986104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fb9a3ddb-19be-48a6-a46e-2c65ff038d9b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:39.987313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fb9a3ddb-19be-48a6-a46e-2c65ff038d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:40.019427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1e546-46ab-479f-9899-07b16101281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:40.020090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e546-46ab-479f-9899-07b16101281a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.020383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e546-46ab-479f-9899-07b16101281a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.020648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1e546-46ab-479f-9899-07b16101281a None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.022049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1e546-46ab-479f-9899-07b16101281a None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:40.023504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1e546-46ab-479f-9899-07b16101281a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:40.030504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 59/115] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:39 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:40.030504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0c2f-fcc5-4510-aa56-d5e3d7955629 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.030504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0c2f-fcc5-4510-aa56-d5e3d7955629 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.030504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0c2f-fcc5-4510-aa56-d5e3d7955629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.047075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-651f0c2f-fcc5-4510-aa56-d5e3d7955629 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:40.048260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-651f0c2f-fcc5-4510-aa56-d5e3d7955629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:40.068386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 57/116] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:40.069668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967f70-6223-48c7-8ae2-2add1189856a None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.069964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967f70-6223-48c7-8ae2-2add1189856a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.070238 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967f70-6223-48c7-8ae2-2add1189856a None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.071484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 58/117] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:40.072281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6967f70-6223-48c7-8ae2-2add1189856a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:40.130452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:40.149138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 60/118] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:40.158738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0c2f-fcc5-4510-aa56-d5e3d7955629 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:40.221220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6967f70-6223-48c7-8ae2-2add1189856a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:40.288876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf2ec3-ff05-4d66-aac7-a831e4c555ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:40.289523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf2ec3-ff05-4d66-aac7-a831e4c555ee None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.289833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf2ec3-ff05-4d66-aac7-a831e4c555ee None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.290113 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf2ec3-ff05-4d66-aac7-a831e4c555ee None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.291835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf2ec3-ff05-4d66-aac7-a831e4c555ee None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:40.293356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf2ec3-ff05-4d66-aac7-a831e4c555ee None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:40.301367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 59/119] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:40 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:40.302559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d5cc-473f-4b81-95c0-090a14be6c5b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.306096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d5cc-473f-4b81-95c0-090a14be6c5b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.306471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d5cc-473f-4b81-95c0-090a14be6c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.323234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:40.334276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0c2f-fcc5-4510-aa56-d5e3d7955629 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:40.348361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0e18d5cc-473f-4b81-95c0-090a14be6c5b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:40.348361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0e18d5cc-473f-4b81-95c0-090a14be6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:40.396659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c29621-f705-4627-bbe8-6c42faa2aade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:40.397275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c29621-f705-4627-bbe8-6c42faa2aade None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.397560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c29621-f705-4627-bbe8-6c42faa2aade None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.397872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c29621-f705-4627-bbe8-6c42faa2aade None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.399853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c29621-f705-4627-bbe8-6c42faa2aade None admin] RBAC: Authorizing `identity:create_grant(project_id=e13bb57123f8483b9d6f24c63738d6be, user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:40.401950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c29621-f705-4627-bbe8-6c42faa2aade None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:40.418600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 60/120] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:40.419725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d5cc-473f-4b81-95c0-090a14be6c5b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:40.467794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 61/121] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:40 2022] PUT /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:40.468724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c29621-f705-4627-bbe8-6c42faa2aade None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:40.468850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:40.538275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d5cc-473f-4b81-95c0-090a14be6c5b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:40.580391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:40.581406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.581406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.581683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.582389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] RBAC: Adding query filter params (role.id=a41ebaad7f8e43ef8c749ed1f26c5d64, scope.project.id=e13bb57123f8483b9d6f24c63738d6be, user.id=c3f1d9acb16f4432af7205dd5f8cb2b0) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:40.582699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:40.584226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:40.591042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 61/122] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:40 2022] GET /identity/v3/role_assignments?user.id=c3f1d9acb16f4432af7205dd5f8cb2b0&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:40.592049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:40.730783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c29621-f705-4627-bbe8-6c42faa2aade None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:40.772138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1242919-32f5-4072-9625-25dae50c131f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:40.787581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:40.796241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b532b-a201-49b5-9760-bba6c47c9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:40.797162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b532b-a201-49b5-9760-bba6c47c9164 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.797547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b532b-a201-49b5-9760-bba6c47c9164 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.797921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b532b-a201-49b5-9760-bba6c47c9164 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.811032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b532b-a201-49b5-9760-bba6c47c9164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-768b532b-a201-49b5-9760-bba6c47c9164 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:40.816495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:40.817560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:40.818649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:40.820484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 62/123] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:40.821216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b532b-a201-49b5-9760-bba6c47c9164 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:40.832769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aed24-6bbe-43f6-a604-ce58254df991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:40.833878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aed24-6bbe-43f6-a604-ce58254df991 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.834261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aed24-6bbe-43f6-a604-ce58254df991 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.834633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aed24-6bbe-43f6-a604-ce58254df991 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.847368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aed24-6bbe-43f6-a604-ce58254df991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:40.850669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f30aed24-6bbe-43f6-a604-ce58254df991 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:40.852825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:40.853922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:40.854884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:40.856821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 62/124] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:40.857757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aed24-6bbe-43f6-a604-ce58254df991 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:40.957476 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b532b-a201-49b5-9760-bba6c47c9164 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:40.970413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aed24-6bbe-43f6-a604-ce58254df991 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.010333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84c69-95a7-4d1c-b0d9-5e52f92b0fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.011184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.011719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84c69-95a7-4d1c-b0d9-5e52f92b0fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.011997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.012311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84c69-95a7-4d1c-b0d9-5e52f92b0fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.012506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.012866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84c69-95a7-4d1c-b0d9-5e52f92b0fb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.012981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.013759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:41.014162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.015665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.025888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84c69-95a7-4d1c-b0d9-5e52f92b0fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-43e84c69-95a7-4d1c-b0d9-5e52f92b0fb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:41.031176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:41.032041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:41.032892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:41.035306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 63/125] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:15:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:41.036327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84c69-95a7-4d1c-b0d9-5e52f92b0fb3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.039729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 63/126] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.047185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.107244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.134339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.164257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84c69-95a7-4d1c-b0d9-5e52f92b0fb3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.209852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.210826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.211306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.211793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.212685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] RBAC: Adding query filter params (name=member) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:41.213572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.215219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.225248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 64/127] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.226391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.275958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049232a-4dfd-41c4-a22d-ed2b46737936 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.341823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbadac5-0874-4586-addb-43ba9b8c8b79 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.356734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.357362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.357683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.357966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.358645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:41.358949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.360701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.374555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 64/128] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.375412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.385431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639b245-0d7e-4966-9c63-cfe6808f11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.386372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b245-0d7e-4966-9c63-cfe6808f11b7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.386853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b245-0d7e-4966-9c63-cfe6808f11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.387336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b245-0d7e-4966-9c63-cfe6808f11b7 None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.388705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639b245-0d7e-4966-9c63-cfe6808f11b7 None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.390806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639b245-0d7e-4966-9c63-cfe6808f11b7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.392866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 65/129] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.398502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639b245-0d7e-4966-9c63-cfe6808f11b7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.409866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.514605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639b245-0d7e-4966-9c63-cfe6808f11b7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.553435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d7888-99c1-409b-a298-13cac9d7110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.554805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d7888-99c1-409b-a298-13cac9d7110d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.555431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d7888-99c1-409b-a298-13cac9d7110d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.555905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d7888-99c1-409b-a298-13cac9d7110d None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.557872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d7888-99c1-409b-a298-13cac9d7110d None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.559969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d7888-99c1-409b-a298-13cac9d7110d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.560671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.562382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 66/130] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.563503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d7888-99c1-409b-a298-13cac9d7110d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.599558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51ea82-a7be-42ec-be4b-bddd043e30f7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.649972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.674481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d7888-99c1-409b-a298-13cac9d7110d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.703423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c52b5-3b13-4ba0-8e2f-2c0705e7434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.704100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c52b5-3b13-4ba0-8e2f-2c0705e7434c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.704354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c52b5-3b13-4ba0-8e2f-2c0705e7434c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.704638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c52b5-3b13-4ba0-8e2f-2c0705e7434c None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.707040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c52b5-3b13-4ba0-8e2f-2c0705e7434c None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.708572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c52b5-3b13-4ba0-8e2f-2c0705e7434c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.710202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 65/131] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.715539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c52b5-3b13-4ba0-8e2f-2c0705e7434c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.732351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7f479-d42b-4c3d-a4b8-483fff57cdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.733288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7f479-d42b-4c3d-a4b8-483fff57cdfe None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.733574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7f479-d42b-4c3d-a4b8-483fff57cdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.733882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7f479-d42b-4c3d-a4b8-483fff57cdfe None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.735829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7f479-d42b-4c3d-a4b8-483fff57cdfe None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.737595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c7f479-d42b-4c3d-a4b8-483fff57cdfe None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.739706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 67/132] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.740566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7f479-d42b-4c3d-a4b8-483fff57cdfe None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.854634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c7f479-d42b-4c3d-a4b8-483fff57cdfe None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.858471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c52b5-3b13-4ba0-8e2f-2c0705e7434c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.890993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509128d7-e880-4ea7-b0e5-2a3486ac5efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.891680 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509128d7-e880-4ea7-b0e5-2a3486ac5efe None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.891970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509128d7-e880-4ea7-b0e5-2a3486ac5efe None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.892253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509128d7-e880-4ea7-b0e5-2a3486ac5efe None admin] PATH_INFO: `/v3/projects/289aaa840ff34576a72cf57a64b7b24b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.893501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509128d7-e880-4ea7-b0e5-2a3486ac5efe None admin] RBAC: Authorizing `identity:get_project(project_id=289aaa840ff34576a72cf57a64b7b24b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.894974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509128d7-e880-4ea7-b0e5-2a3486ac5efe None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.896775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 68/133] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/projects/289aaa840ff34576a72cf57a64b7b24b => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.897970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4cb05-3c4e-4e2c-8077-52311ad0e405 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.898258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4cb05-3c4e-4e2c-8077-52311ad0e405 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.898535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4cb05-3c4e-4e2c-8077-52311ad0e405 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.898900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217132a-1814-4093-91fe-d9a6e276bf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.899743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217132a-1814-4093-91fe-d9a6e276bf55 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.899845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 69/134] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:41.900349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217132a-1814-4093-91fe-d9a6e276bf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.900632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4cb05-3c4e-4e2c-8077-52311ad0e405 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.901083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217132a-1814-4093-91fe-d9a6e276bf55 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.902440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217132a-1814-4093-91fe-d9a6e276bf55 None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.904702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217132a-1814-4093-91fe-d9a6e276bf55 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.906795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 66/135] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.908222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186b94-ccb9-47d5-ab14-549bdcf89f2a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.908722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186b94-ccb9-47d5-ab14-549bdcf89f2a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.909193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186b94-ccb9-47d5-ab14-549bdcf89f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.913648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.929572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7b186b94-ccb9-47d5-ab14-549bdcf89f2a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:41.931144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7b186b94-ccb9-47d5-ab14-549bdcf89f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:41.951583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:42.006985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 67/136] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:42.007591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4cb05-3c4e-4e2c-8077-52311ad0e405 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.008775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186b94-ccb9-47d5-ab14-549bdcf89f2a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.043017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646776-ca8a-444f-b55e-5a7f405badb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.043743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646776-ca8a-444f-b55e-5a7f405badb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.044102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646776-ca8a-444f-b55e-5a7f405badb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.044349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646776-ca8a-444f-b55e-5a7f405badb4 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be/users/e585ef5ba4f347e99c8c23cbb6cb501a/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.046370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26646776-ca8a-444f-b55e-5a7f405badb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e13bb57123f8483b9d6f24c63738d6be, user_id=e585ef5ba4f347e99c8c23cbb6cb501a, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.048484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26646776-ca8a-444f-b55e-5a7f405badb4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.119890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186b94-ccb9-47d5-ab14-549bdcf89f2a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.149709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 70/137] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:41 2022] PUT /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be/users/e585ef5ba4f347e99c8c23cbb6cb501a/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:42.155665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646776-ca8a-444f-b55e-5a7f405badb4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.161730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b31b3-cdfa-42d1-9a9a-faef95b5b595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.162677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b31b3-cdfa-42d1-9a9a-faef95b5b595 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.163161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b31b3-cdfa-42d1-9a9a-faef95b5b595 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.163632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b31b3-cdfa-42d1-9a9a-faef95b5b595 None admin] PATH_INFO: `/v3/projects/289aaa840ff34576a72cf57a64b7b24b/users/e585ef5ba4f347e99c8c23cbb6cb501a/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.166683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b31b3-cdfa-42d1-9a9a-faef95b5b595 None admin] RBAC: Authorizing `identity:create_grant(project_id=289aaa840ff34576a72cf57a64b7b24b, user_id=e585ef5ba4f347e99c8c23cbb6cb501a, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.168409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b31b3-cdfa-42d1-9a9a-faef95b5b595 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.260384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 68/138] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:42 2022] PUT /identity/v3/projects/289aaa840ff34576a72cf57a64b7b24b/users/e585ef5ba4f347e99c8c23cbb6cb501a/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:42.279266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:42.319828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646776-ca8a-444f-b55e-5a7f405badb4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.363515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b31b3-cdfa-42d1-9a9a-faef95b5b595 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.382747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b84f-6e90-4a84-bfcd-6ef7f0e59a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.383163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b84f-6e90-4a84-bfcd-6ef7f0e59a47 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.383450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b84f-6e90-4a84-bfcd-6ef7f0e59a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.383723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b84f-6e90-4a84-bfcd-6ef7f0e59a47 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be/users/e585ef5ba4f347e99c8c23cbb6cb501a/roles/0e7d21c594094cef90457df82be0bce6` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.387957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:42.388101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34b84f-6e90-4a84-bfcd-6ef7f0e59a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=e13bb57123f8483b9d6f24c63738d6be, user_id=e585ef5ba4f347e99c8c23cbb6cb501a, role_id=0e7d21c594094cef90457df82be0bce6)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.389593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34b84f-6e90-4a84-bfcd-6ef7f0e59a47 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.491902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b31b3-cdfa-42d1-9a9a-faef95b5b595 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.495651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 71/139] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:42 2022] PUT /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be/users/e585ef5ba4f347e99c8c23cbb6cb501a/roles/0e7d21c594094cef90457df82be0bce6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:42.540153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6e18-65b9-4da6-944f-e9e01f7a7190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.540920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6e18-65b9-4da6-944f-e9e01f7a7190 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.541988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6e18-65b9-4da6-944f-e9e01f7a7190 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.542267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6e18-65b9-4da6-944f-e9e01f7a7190 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.543987 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6e18-65b9-4da6-944f-e9e01f7a7190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.545587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6e18-65b9-4da6-944f-e9e01f7a7190 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.547562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 69/140] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:42.553196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b84f-6e90-4a84-bfcd-6ef7f0e59a47 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.665030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b84f-6e90-4a84-bfcd-6ef7f0e59a47 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.694847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:42.705427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70ef4f-8089-452d-abd9-af1bc93412d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.706104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ef4f-8089-452d-abd9-af1bc93412d8 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.706386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ef4f-8089-452d-abd9-af1bc93412d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.711176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ef4f-8089-452d-abd9-af1bc93412d8 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.711176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70ef4f-8089-452d-abd9-af1bc93412d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.711176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70ef4f-8089-452d-abd9-af1bc93412d8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.829299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 72/141] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:15:42 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:42.897284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74edda-d3e4-4853-8505-ce08d28e5098 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.897654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74edda-d3e4-4853-8505-ce08d28e5098 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.897911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74edda-d3e4-4853-8505-ce08d28e5098 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.899299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 70/142] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:42.905627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0bc30-1a92-413e-968c-e2550de1786a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.905941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0bc30-1a92-413e-968c-e2550de1786a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.906226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0bc30-1a92-413e-968c-e2550de1786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.925376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-bbb0bc30-1a92-413e-968c-e2550de1786a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:42.926550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bbb0bc30-1a92-413e-968c-e2550de1786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:43.005221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 73/143] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:43.199104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd530-71cc-465e-9bb2-23f503a551f9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:43.199691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd530-71cc-465e-9bb2-23f503a551f9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:43.199691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd530-71cc-465e-9bb2-23f503a551f9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:43.200920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 71/144] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:43.206438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f583c62-9cac-4e5a-94a0-606a16bca52f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:43.206884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f583c62-9cac-4e5a-94a0-606a16bca52f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:43.207086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f583c62-9cac-4e5a-94a0-606a16bca52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:43.234742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7f583c62-9cac-4e5a-94a0-606a16bca52f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:43.236201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7f583c62-9cac-4e5a-94a0-606a16bca52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:43.325842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 74/145] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:43.461768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcd530-71cc-465e-9bb2-23f503a551f9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:43.559493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:43.581137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcd530-71cc-465e-9bb2-23f503a551f9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:43.617526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb9a7-417c-4cfc-af6c-c78bd3affd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:43.618417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb9a7-417c-4cfc-af6c-c78bd3affd77 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:43.619286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb9a7-417c-4cfc-af6c-c78bd3affd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:43.619579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb9a7-417c-4cfc-af6c-c78bd3affd77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:43.632255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb9a7-417c-4cfc-af6c-c78bd3affd77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-7fccb9a7-417c-4cfc-af6c-c78bd3affd77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:43.637816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:43.638652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:43.639406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 72/146] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:43.646263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f583c62-9cac-4e5a-94a0-606a16bca52f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:43.674955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb9a7-417c-4cfc-af6c-c78bd3affd77 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:43.733781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:43.835344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f583c62-9cac-4e5a-94a0-606a16bca52f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:43.851067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb9a7-417c-4cfc-af6c-c78bd3affd77 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:43.894665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:43.895288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:43.895564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:43.895836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:43.896498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:43.896798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:43.898226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:43.915588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 75/147] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:43.917547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54bc6c-8436-4b06-b34d-7d212dc03451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:43.918225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bc6c-8436-4b06-b34d-7d212dc03451 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:43.918503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bc6c-8436-4b06-b34d-7d212dc03451 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:43.918772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bc6c-8436-4b06-b34d-7d212dc03451 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:43.923350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:43.947799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54bc6c-8436-4b06-b34d-7d212dc03451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9a54bc6c-8436-4b06-b34d-7d212dc03451 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:43.954489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:43.955343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:15:43.956110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:43.965364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 73/148] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:43.974776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54bc6c-8436-4b06-b34d-7d212dc03451 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:43.978571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:44.130311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a24973-4fca-4ff9-b29e-4b377da0574d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:44.143885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:44.149012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54bc6c-8436-4b06-b34d-7d212dc03451 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:44.190788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbf3d5-e09f-49fe-a66e-aa77998a22db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:44.192136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbf3d5-e09f-49fe-a66e-aa77998a22db None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:44.193097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbf3d5-e09f-49fe-a66e-aa77998a22db None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:44.193377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbf3d5-e09f-49fe-a66e-aa77998a22db None admin] PATH_INFO: `/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:44.194681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbf3d5-e09f-49fe-a66e-aa77998a22db None admin] RBAC: Authorizing `identity:get_user(user_id=7d0d465dd7b044aba7e2c5ee9fdc6c2c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:44.196168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbf3d5-e09f-49fe-a66e-aa77998a22db None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:44.198345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 76/149] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:43 2022] GET /identity/v3/users/7d0d465dd7b044aba7e2c5ee9fdc6c2c => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:44.204471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:44.205104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:44.205387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:44.205688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:44.206369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:44.206669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:44.208495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbf3d5-e09f-49fe-a66e-aa77998a22db None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:44.209722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:44.230247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 74/150] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:44.247293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:44.374463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbf3d5-e09f-49fe-a66e-aa77998a22db None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:44.406426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:44.419517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaab1c-7b75-4559-8250-aea22f86b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:44.423626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaab1c-7b75-4559-8250-aea22f86b2be None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:44.423626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaab1c-7b75-4559-8250-aea22f86b2be None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:44.423626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaab1c-7b75-4559-8250-aea22f86b2be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:44.484232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:44.496381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ffde3-aa4d-454a-b867-0660f14e004e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:44.538664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaab1c-7b75-4559-8250-aea22f86b2be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:44.540194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaab1c-7b75-4559-8250-aea22f86b2be None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:44.571414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97eea-b4d0-4047-9619-c2ed92ac1124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:44.572102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97eea-b4d0-4047-9619-c2ed92ac1124 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:44.572914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97eea-b4d0-4047-9619-c2ed92ac1124 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:44.573187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97eea-b4d0-4047-9619-c2ed92ac1124 None admin] PATH_INFO: `/v3/users/c3f1d9acb16f4432af7205dd5f8cb2b0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:44.574429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc97eea-b4d0-4047-9619-c2ed92ac1124 None admin] RBAC: Authorizing `identity:get_user(user_id=c3f1d9acb16f4432af7205dd5f8cb2b0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:44.575900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc97eea-b4d0-4047-9619-c2ed92ac1124 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:44.577587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 75/151] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:44 2022] GET /identity/v3/users/c3f1d9acb16f4432af7205dd5f8cb2b0 => generated 289 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:44.585188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97eea-b4d0-4047-9619-c2ed92ac1124 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:44.773151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97eea-b4d0-4047-9619-c2ed92ac1124 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:44.780077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 77/152] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:44.785858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaab1c-7b75-4559-8250-aea22f86b2be None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:44.844466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:44.855520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e84b8-1d54-4194-acd6-b35ce60094f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:44.856184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e84b8-1d54-4194-acd6-b35ce60094f1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:44.856462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e84b8-1d54-4194-acd6-b35ce60094f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:44.856738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e84b8-1d54-4194-acd6-b35ce60094f1 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:44.860287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e84b8-1d54-4194-acd6-b35ce60094f1 None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:44.862795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e84b8-1d54-4194-acd6-b35ce60094f1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:44.874633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 76/153] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:44 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:44.880245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e84b8-1d54-4194-acd6-b35ce60094f1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:44.943868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:44.984766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaab1c-7b75-4559-8250-aea22f86b2be None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:45.042418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47850e11-0650-4975-8c00-9c2947be0e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:45.042994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47850e11-0650-4975-8c00-9c2947be0e6b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.043339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47850e11-0650-4975-8c00-9c2947be0e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.043610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47850e11-0650-4975-8c00-9c2947be0e6b None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.044947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47850e11-0650-4975-8c00-9c2947be0e6b None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:45.046539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47850e11-0650-4975-8c00-9c2947be0e6b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:45.048201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 78/154] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:44 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:45.049353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3467-1ee7-4afc-a073-85975af3752a None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.049650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3467-1ee7-4afc-a073-85975af3752a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.049932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3467-1ee7-4afc-a073-85975af3752a None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.051295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 79/155] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:45.057827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e3467-1ee7-4afc-a073-85975af3752a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:45.154025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e84b8-1d54-4194-acd6-b35ce60094f1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:45.221017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e3467-1ee7-4afc-a073-85975af3752a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:45.271262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0270ad-3e95-469c-b2b4-423e0be63e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:45.271889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0270ad-3e95-469c-b2b4-423e0be63e6f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.272173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0270ad-3e95-469c-b2b4-423e0be63e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.272449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0270ad-3e95-469c-b2b4-423e0be63e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.272880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825f470-fe15-4f15-8cf7-936650537260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:45.273322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0270ad-3e95-469c-b2b4-423e0be63e6f None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=e13bb57123f8483b9d6f24c63738d6be, user.id=7d0d465dd7b044aba7e2c5ee9fdc6c2c) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:45.273474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0270ad-3e95-469c-b2b4-423e0be63e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:45.274464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f470-fe15-4f15-8cf7-936650537260 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.274954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f470-fe15-4f15-8cf7-936650537260 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.275055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0270ad-3e95-469c-b2b4-423e0be63e6f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:45.276040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f470-fe15-4f15-8cf7-936650537260 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be/users/c3f1d9acb16f4432af7205dd5f8cb2b0/roles/a41ebaad7f8e43ef8c749ed1f26c5d64` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.282370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 80/156] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:45 2022] GET /identity/v3/role_assignments?user.id=7d0d465dd7b044aba7e2c5ee9fdc6c2c&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:45.283513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825f470-fe15-4f15-8cf7-936650537260 None admin] RBAC: Authorizing `identity:create_grant(project_id=e13bb57123f8483b9d6f24c63738d6be, user_id=c3f1d9acb16f4432af7205dd5f8cb2b0, role_id=a41ebaad7f8e43ef8c749ed1f26c5d64)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:45.283788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233dbf0-72d6-4513-9111-61862c8797f1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.284075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233dbf0-72d6-4513-9111-61862c8797f1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.284349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233dbf0-72d6-4513-9111-61862c8797f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.285870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825f470-fe15-4f15-8cf7-936650537260 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:45.319380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d233dbf0-72d6-4513-9111-61862c8797f1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:45.321010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d233dbf0-72d6-4513-9111-61862c8797f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:45.333996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:45.367605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 77/157] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:44 2022] PUT /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be/users/c3f1d9acb16f4432af7205dd5f8cb2b0/roles/a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:45.413217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 81/158] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:45.799944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084263-6e3a-4dc0-8fd6-b9d19f667855 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.800314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084263-6e3a-4dc0-8fd6-b9d19f667855 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.800493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084263-6e3a-4dc0-8fd6-b9d19f667855 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.802092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 78/159] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:45.807727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601f2e4-a13e-45d7-9d8f-2d7356832e8e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.808019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601f2e4-a13e-45d7-9d8f-2d7356832e8e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.808320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601f2e4-a13e-45d7-9d8f-2d7356832e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.830174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f601f2e4-a13e-45d7-9d8f-2d7356832e8e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:45.831361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f601f2e4-a13e-45d7-9d8f-2d7356832e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:45.883474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084263-6e3a-4dc0-8fd6-b9d19f667855 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:45.937037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 82/160] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:45.973088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f70df-d87b-4be8-93cd-936b95faa480 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.973416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f70df-d87b-4be8-93cd-936b95faa480 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.973649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f70df-d87b-4be8-93cd-936b95faa480 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.975006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 83/161] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:45.982890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d15f6-8534-45a1-9721-241873ba65f0 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.983176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d15f6-8534-45a1-9721-241873ba65f0 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.983455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d15f6-8534-45a1-9721-241873ba65f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.003475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.016120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8d4d15f6-8534-45a1-9721-241873ba65f0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:46.017328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8d4d15f6-8534-45a1-9721-241873ba65f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:46.106242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084263-6e3a-4dc0-8fd6-b9d19f667855 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.163540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.173880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ab54-453d-402e-8c76-fea4745bae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.176141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ab54-453d-402e-8c76-fea4745bae28 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.176141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ab54-453d-402e-8c76-fea4745bae28 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.176312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 84/162] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:46.176384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14ab54-453d-402e-8c76-fea4745bae28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.202126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14ab54-453d-402e-8c76-fea4745bae28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-4e14ab54-453d-402e-8c76-fea4745bae28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:46.214882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:46.216073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:46.216909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:46.218834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 79/163] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:46.224711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d15f6-8534-45a1-9721-241873ba65f0 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.349493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d15f6-8534-45a1-9721-241873ba65f0 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.399273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.399897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.400200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.401009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.401712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] RBAC: Adding query filter params (name=member) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:46.402016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.403422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.417166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 85/164] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:46.422872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ab54-453d-402e-8c76-fea4745bae28 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.450274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.541872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.574174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14ab54-453d-402e-8c76-fea4745bae28 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.616145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aaa76-5561-407b-89e3-b385c9f36a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.617398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aaa76-5561-407b-89e3-b385c9f36a6b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.617861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aaa76-5561-407b-89e3-b385c9f36a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.618286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aaa76-5561-407b-89e3-b385c9f36a6b None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.620376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aaa76-5561-407b-89e3-b385c9f36a6b None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.629352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.630197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aaa76-5561-407b-89e3-b385c9f36a6b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.632231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 80/165] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:46.640525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aaa76-5561-407b-89e3-b385c9f36a6b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.664455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d38133-e554-4505-bdfb-dd6fbfd15c71 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.758906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71b31-22f5-4bbe-a7c2-43e0429b5a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.759597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71b31-22f5-4bbe-a7c2-43e0429b5a39 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.760404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71b31-22f5-4bbe-a7c2-43e0429b5a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.760675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71b31-22f5-4bbe-a7c2-43e0429b5a39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.774062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aaa76-5561-407b-89e3-b385c9f36a6b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.786489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b71b31-22f5-4bbe-a7c2-43e0429b5a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-77b71b31-22f5-4bbe-a7c2-43e0429b5a39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:46.791880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:46.792784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:46.794166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:46.798127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 86/166] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:46.799101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71b31-22f5-4bbe-a7c2-43e0429b5a39 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.816639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6d79-4c0c-4410-b939-57f9ed1efa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.817722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6d79-4c0c-4410-b939-57f9ed1efa92 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.818293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6d79-4c0c-4410-b939-57f9ed1efa92 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.818767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c6d79-4c0c-4410-b939-57f9ed1efa92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.890468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.906772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c6d79-4c0c-4410-b939-57f9ed1efa92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.908401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c6d79-4c0c-4410-b939-57f9ed1efa92 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:47.023738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71b31-22f5-4bbe-a7c2-43e0429b5a39 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:47.064633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 81/167] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:15:47.065603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6d79-4c0c-4410-b939-57f9ed1efa92 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:47.076649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:47.108158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497addd-a90f-47a5-b31c-ffa6e82a5e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:47.109381 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497addd-a90f-47a5-b31c-ffa6e82a5e87 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.109880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497addd-a90f-47a5-b31c-ffa6e82a5e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.110318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497addd-a90f-47a5-b31c-ffa6e82a5e87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.142283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497addd-a90f-47a5-b31c-ffa6e82a5e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-1497addd-a90f-47a5-b31c-ffa6e82a5e87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:47.147351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:47.148250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:47.149025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:47.151481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 87/168] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:47.157369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552c71-d27c-40b3-80e6-46ff1f645001 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.157899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552c71-d27c-40b3-80e6-46ff1f645001 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.158353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6552c71-d27c-40b3-80e6-46ff1f645001 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.159836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 88/169] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:47.163557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6552c71-d27c-40b3-80e6-46ff1f645001 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:47.172975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:47.188786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c6d79-4c0c-4410-b939-57f9ed1efa92 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:47.234834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:47.235962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.237139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.237825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.239530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:47.240452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:47.242484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:47.253570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 82/170] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:47.254714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:47.355951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6552c71-d27c-40b3-80e6-46ff1f645001 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:47.418081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d67473-72dd-4836-80b9-e33f8fa65c81 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:47.440572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5480989-a19f-4ce9-9c4d-b7f24a5c1bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:47.442370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5480989-a19f-4ce9-9c4d-b7f24a5c1bca None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.443034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5480989-a19f-4ce9-9c4d-b7f24a5c1bca None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.444904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5480989-a19f-4ce9-9c4d-b7f24a5c1bca None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.447346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5480989-a19f-4ce9-9c4d-b7f24a5c1bca None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:47.449221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5480989-a19f-4ce9-9c4d-b7f24a5c1bca None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:47.451910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 89/171] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:47 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:47.453394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c358ef-58e0-4cc2-83a7-a1445f50b0ec None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.455295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c358ef-58e0-4cc2-83a7-a1445f50b0ec None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.456617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c358ef-58e0-4cc2-83a7-a1445f50b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.491488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:47.492897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.493389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.493966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.494842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:47.495420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:47.497669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f0c358ef-58e0-4cc2-83a7-a1445f50b0ec None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:47.499135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f0c358ef-58e0-4cc2-83a7-a1445f50b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:47.501920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:47.516843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 83/172] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:47.517866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:47.545668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:47.550887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:47.575306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 90/173] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:47.581933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c358ef-58e0-4cc2-83a7-a1445f50b0ec None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:47.731978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332def5a-a455-44bf-8208-7c4b0fe95f96 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:47.771677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c358ef-58e0-4cc2-83a7-a1445f50b0ec None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:47.783967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754b8a0-ef44-483f-acc0-558eed4f6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:47.784606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b8a0-ef44-483f-acc0-558eed4f6d2d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.784885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b8a0-ef44-483f-acc0-558eed4f6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.785159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754b8a0-ef44-483f-acc0-558eed4f6d2d None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.786319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754b8a0-ef44-483f-acc0-558eed4f6d2d None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:47.787855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754b8a0-ef44-483f-acc0-558eed4f6d2d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:47.795617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 84/174] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:47 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:47.796502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754b8a0-ef44-483f-acc0-558eed4f6d2d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:47.816729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ec277-9360-486f-a6f7-2eaac8775b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:47.817343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ec277-9360-486f-a6f7-2eaac8775b21 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.817637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ec277-9360-486f-a6f7-2eaac8775b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.817931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ec277-9360-486f-a6f7-2eaac8775b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.818673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ec277-9360-486f-a6f7-2eaac8775b21 None admin] RBAC: Adding query filter params (role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=e13bb57123f8483b9d6f24c63738d6be, user.id=e585ef5ba4f347e99c8c23cbb6cb501a) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:47.819413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ec277-9360-486f-a6f7-2eaac8775b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:47.821184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ec277-9360-486f-a6f7-2eaac8775b21 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:47.829921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 91/175] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:47 2022] GET /identity/v3/role_assignments?user.id=e585ef5ba4f347e99c8c23cbb6cb501a&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:47.836285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bef5-9e41-498d-ab78-951a7f257acf None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.836285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bef5-9e41-498d-ab78-951a7f257acf None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.836285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bef5-9e41-498d-ab78-951a7f257acf None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.836285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 92/176] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:47.836285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8bae-439c-49f9-b979-155d489c2ee8 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.836285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8bae-439c-49f9-b979-155d489c2ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.836714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b8bae-439c-49f9-b979-155d489c2ee8 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.836714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 93/177] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:47.836840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8bae-439c-49f9-b979-155d489c2ee8 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:47.925350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:47.936649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:47.992783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754b8a0-ef44-483f-acc0-558eed4f6d2d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.000377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b8bae-439c-49f9-b979-155d489c2ee8 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.043046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aeebf2-1cc2-4241-ace9-4d760f9eaf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.043511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11e03-e4b7-4118-b612-8a5c67fb0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.043717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeebf2-1cc2-4241-ace9-4d760f9eaf32 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.043994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeebf2-1cc2-4241-ace9-4d760f9eaf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.044213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11e03-e4b7-4118-b612-8a5c67fb0933 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.044317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aeebf2-1cc2-4241-ace9-4d760f9eaf32 None admin] PATH_INFO: `/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.044502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11e03-e4b7-4118-b612-8a5c67fb0933 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.044784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11e03-e4b7-4118-b612-8a5c67fb0933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.045541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aeebf2-1cc2-4241-ace9-4d760f9eaf32 None admin] RBAC: Authorizing `identity:get_user(user_id=e585ef5ba4f347e99c8c23cbb6cb501a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:48.047191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aeebf2-1cc2-4241-ace9-4d760f9eaf32 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:48.049270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 85/178] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:47 2022] GET /identity/v3/users/e585ef5ba4f347e99c8c23cbb6cb501a => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:48.051425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a29be-5635-415e-8c8f-6a237c1ea5b6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.051703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a29be-5635-415e-8c8f-6a237c1ea5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.051973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a29be-5635-415e-8c8f-6a237c1ea5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.076258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cb8a29be-5635-415e-8c8f-6a237c1ea5b6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:48.076672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cb8a29be-5635-415e-8c8f-6a237c1ea5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:48.146925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 86/179] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:48.148705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437460-3393-490a-b91c-f130b765336d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.149084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437460-3393-490a-b91c-f130b765336d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.149461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437460-3393-490a-b91c-f130b765336d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.155234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c11e03-e4b7-4118-b612-8a5c67fb0933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:48.156944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c11e03-e4b7-4118-b612-8a5c67fb0933 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:48.169485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-75437460-3393-490a-b91c-f130b765336d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:48.170974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-75437460-3393-490a-b91c-f130b765336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:48.204503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:48.254429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 87/180] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:48.255712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75437460-3393-490a-b91c-f130b765336d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:48.280633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:48.292843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 94/181] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:48.295700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11e03-e4b7-4118-b612-8a5c67fb0933 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:48.405978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75437460-3393-490a-b91c-f130b765336d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.420011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11e03-e4b7-4118-b612-8a5c67fb0933 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.445055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1f167-c5fa-40e8-a555-8a6d27ab43c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.445654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1f167-c5fa-40e8-a555-8a6d27ab43c5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.446037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1f167-c5fa-40e8-a555-8a6d27ab43c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.446313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1f167-c5fa-40e8-a555-8a6d27ab43c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.454833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc503d4-95af-48eb-b478-fd21c85448b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.455462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc503d4-95af-48eb-b478-fd21c85448b5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.455741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc503d4-95af-48eb-b478-fd21c85448b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.456023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc503d4-95af-48eb-b478-fd21c85448b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.456859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1f167-c5fa-40e8-a555-8a6d27ab43c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-00d1f167-c5fa-40e8-a555-8a6d27ab43c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:48.461516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:48.462461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:48.463857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:48.468059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 88/182] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:48.468689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1f167-c5fa-40e8-a555-8a6d27ab43c5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:48.468819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:48.528145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc503d4-95af-48eb-b478-fd21c85448b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:48.529560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc503d4-95af-48eb-b478-fd21c85448b5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:48.542778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:48.582778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1f167-c5fa-40e8-a555-8a6d27ab43c5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.616370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa798b-28c8-4c5b-8681-ea0b49d6a551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.617003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa798b-28c8-4c5b-8681-ea0b49d6a551 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.617282 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa798b-28c8-4c5b-8681-ea0b49d6a551 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.617551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa798b-28c8-4c5b-8681-ea0b49d6a551 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.618700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa798b-28c8-4c5b-8681-ea0b49d6a551 None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:48.620200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa798b-28c8-4c5b-8681-ea0b49d6a551 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:48.621850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 89/183] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:48 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:48.627035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ad96-b29c-4a23-b38c-24ecd5d27c7a None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.627390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ad96-b29c-4a23-b38c-24ecd5d27c7a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.627666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ad96-b29c-4a23-b38c-24ecd5d27c7a None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.628896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 90/184] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:48.629596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4ad96-b29c-4a23-b38c-24ecd5d27c7a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:48.631479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 95/185] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:48.632316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc503d4-95af-48eb-b478-fd21c85448b5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:48.675245 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:48.731584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc503d4-95af-48eb-b478-fd21c85448b5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.732336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4ad96-b29c-4a23-b38c-24ecd5d27c7a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.764786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.765383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.765689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.765960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.766098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b530c50-f2cd-47e0-a945-b559dc2d458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.766616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:48.766709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b530c50-f2cd-47e0-a945-b559dc2d458c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.766913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:48.767000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b530c50-f2cd-47e0-a945-b559dc2d458c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.767252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b530c50-f2cd-47e0-a945-b559dc2d458c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.768306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:48.770012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:48.776641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 96/186] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:48.777432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:48.778713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b530c50-f2cd-47e0-a945-b559dc2d458c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1b530c50-f2cd-47e0-a945-b559dc2d458c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:48.783480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:48.793581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 91/187] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:15:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:48.794577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b530c50-f2cd-47e0-a945-b559dc2d458c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:48.883954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768f48-b17c-4946-bbd0-f8da546b1974 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.886328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:48.901488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b530c50-f2cd-47e0-a945-b559dc2d458c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:48.918381 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3211014-be9b-4a4e-9ed9-335a582fe6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.919007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3211014-be9b-4a4e-9ed9-335a582fe6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.919288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3211014-be9b-4a4e-9ed9-335a582fe6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.919560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3211014-be9b-4a4e-9ed9-335a582fe6d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.920664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3211014-be9b-4a4e-9ed9-335a582fe6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:48.922145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3211014-be9b-4a4e-9ed9-335a582fe6d7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:48.923735 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 97/188] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:48.924998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd73c2-8566-462b-8c7f-48d1c495f1b1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.925110 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd73c2-8566-462b-8c7f-48d1c495f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.925414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd73c2-8566-462b-8c7f-48d1c495f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.935269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:48.935893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:48.936166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:48.936434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:48.937160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] RBAC: Adding query filter params (role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=e13bb57123f8483b9d6f24c63738d6be, user.id=e585ef5ba4f347e99c8c23cbb6cb501a) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:48.937458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:48.938910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:48.941990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-20cd73c2-8566-462b-8c7f-48d1c495f1b1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:48.943167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-20cd73c2-8566-462b-8c7f-48d1c495f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:48.944707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 92/189] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:48 2022] GET /identity/v3/role_assignments?user.id=e585ef5ba4f347e99c8c23cbb6cb501a&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=0e7d21c594094cef90457df82be0bce6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:48.945296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.011476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.033138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 98/190] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:49.038950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd73c2-8566-462b-8c7f-48d1c495f1b1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.062499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5509337-2c87-4989-957e-8a58c5b98bbe None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.105654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4902-38c0-4a82-afc5-a57048062e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.105654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4902-38c0-4a82-afc5-a57048062e75 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.105654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4902-38c0-4a82-afc5-a57048062e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.105654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4902-38c0-4a82-afc5-a57048062e75 None admin] PATH_INFO: `/v3/projects/289aaa840ff34576a72cf57a64b7b24b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.107142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa4902-38c0-4a82-afc5-a57048062e75 None admin] RBAC: Authorizing `identity:get_project(project_id=289aaa840ff34576a72cf57a64b7b24b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.108603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa4902-38c0-4a82-afc5-a57048062e75 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.111211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 93/191] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:48 2022] GET /identity/v3/projects/289aaa840ff34576a72cf57a64b7b24b => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:49.112046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4902-38c0-4a82-afc5-a57048062e75 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.167892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd73c2-8566-462b-8c7f-48d1c495f1b1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.171532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.219048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226d6c5-b73a-4e30-aed8-767d3d555b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.219700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226d6c5-b73a-4e30-aed8-767d3d555b55 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.219988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226d6c5-b73a-4e30-aed8-767d3d555b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.220637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226d6c5-b73a-4e30-aed8-767d3d555b55 None admin] PATH_INFO: `/v3/users/906cb6e2f74d4b969d63e106b620b38b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.235946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226d6c5-b73a-4e30-aed8-767d3d555b55 None admin] RBAC: Authorizing `identity:get_user(user_id=906cb6e2f74d4b969d63e106b620b38b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.237416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226d6c5-b73a-4e30-aed8-767d3d555b55 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.241773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 99/192] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/users/906cb6e2f74d4b969d63e106b620b38b => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:49.241773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226d6c5-b73a-4e30-aed8-767d3d555b55 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.247227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4902-38c0-4a82-afc5-a57048062e75 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.275807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.284903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.286146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.286691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.287463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.288350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:49.288852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.290434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.299274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 94/193] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:49.300247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.349094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226d6c5-b73a-4e30-aed8-767d3d555b55 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.382925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19bef8-dcfb-47e4-8fde-8a908d735e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.383527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19bef8-dcfb-47e4-8fde-8a908d735e87 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.383804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19bef8-dcfb-47e4-8fde-8a908d735e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.384074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19bef8-dcfb-47e4-8fde-8a908d735e87 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.385284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19bef8-dcfb-47e4-8fde-8a908d735e87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.386778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19bef8-dcfb-47e4-8fde-8a908d735e87 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.398431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a563b-2038-47ff-bcad-527cd3642d69 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.431640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.432238 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.432516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.432786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.433507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] RBAC: Adding query filter params (role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=289aaa840ff34576a72cf57a64b7b24b, user.id=e585ef5ba4f347e99c8c23cbb6cb501a) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:49.433839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.435261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.440881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 95/194] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/role_assignments?user.id=e585ef5ba4f347e99c8c23cbb6cb501a&scope.project.id=289aaa840ff34576a72cf57a64b7b24b&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:49.442765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.489840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 100/195] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:15:49 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:49.490986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19bef8-dcfb-47e4-8fde-8a908d735e87 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.513184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.530053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.571406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366c3dc-4229-4978-9959-b57589b84857 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.615660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02bb06-82af-40b9-befd-f461081ce67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.617541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb06-82af-40b9-befd-f461081ce67c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.617989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb06-82af-40b9-befd-f461081ce67c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.618361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb06-82af-40b9-befd-f461081ce67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.646642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19bef8-dcfb-47e4-8fde-8a908d735e87 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.696342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9e540-7328-4d6a-9f97-54abced57fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.697005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9e540-7328-4d6a-9f97-54abced57fea None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.697972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9e540-7328-4d6a-9f97-54abced57fea None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.698508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9e540-7328-4d6a-9f97-54abced57fea None admin] PATH_INFO: `/v3/users/906cb6e2f74d4b969d63e106b620b38b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.699550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9e540-7328-4d6a-9f97-54abced57fea None admin] RBAC: Authorizing `identity:get_user(user_id=906cb6e2f74d4b969d63e106b620b38b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.701065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9e540-7328-4d6a-9f97-54abced57fea None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.706026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 101/196] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/users/906cb6e2f74d4b969d63e106b620b38b => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:49.706026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9e540-7328-4d6a-9f97-54abced57fea None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.715638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02bb06-82af-40b9-befd-f461081ce67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.719844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02bb06-82af-40b9-befd-f461081ce67c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.791119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.811937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.833635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9e540-7328-4d6a-9f97-54abced57fea None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.848691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 96/197] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:49.850052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02bb06-82af-40b9-befd-f461081ce67c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.874992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b13d2-2c17-49d2-aa85-6fb9a452ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.875764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b13d2-2c17-49d2-aa85-6fb9a452ef35 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.876148 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b13d2-2c17-49d2-aa85-6fb9a452ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.876521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b13d2-2c17-49d2-aa85-6fb9a452ef35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.890399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b13d2-2c17-49d2-aa85-6fb9a452ef35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-586b13d2-2c17-49d2-aa85-6fb9a452ef35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:49.895514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:49.896412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:49.897300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 102/198] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:49.898026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b13d2-2c17-49d2-aa85-6fb9a452ef35 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.967862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02bb06-82af-40b9-befd-f461081ce67c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.003190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b13d2-2c17-49d2-aa85-6fb9a452ef35 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.007045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558e222-9dd6-4234-b7cb-fd582649a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.007945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558e222-9dd6-4234-b7cb-fd582649a85e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.008444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558e222-9dd6-4234-b7cb-fd582649a85e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.008936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558e222-9dd6-4234-b7cb-fd582649a85e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.039860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:50.043870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffebb9-e390-4e9f-af84-2fd147ade234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.044769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffebb9-e390-4e9f-af84-2fd147ade234 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.045249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffebb9-e390-4e9f-af84-2fd147ade234 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.045789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffebb9-e390-4e9f-af84-2fd147ade234 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.047198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffebb9-e390-4e9f-af84-2fd147ade234 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.048737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffebb9-e390-4e9f-af84-2fd147ade234 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.050673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 103/199] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:50.056377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffebb9-e390-4e9f-af84-2fd147ade234 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:50.072892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:50.104602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558e222-9dd6-4234-b7cb-fd582649a85e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.106055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558e222-9dd6-4234-b7cb-fd582649a85e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.174341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffebb9-e390-4e9f-af84-2fd147ade234 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.221279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.222197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.222845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.223123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.224121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:50.224695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.226853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.229579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 97/200] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:50.230460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558e222-9dd6-4234-b7cb-fd582649a85e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:50.245980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 104/201] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:50.246865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:50.309568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:50.331829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:50.361494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558e222-9dd6-4234-b7cb-fd582649a85e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.365944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e9a84-3bed-44cb-a4bb-cc37288aee1c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.404081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.404682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.404959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.405229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.405975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=28150185d6e141fcb8b89982937b34cb, user.id=906cb6e2f74d4b969d63e106b620b38b) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:50.406281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.407716 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.413388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 98/202] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:50 2022] GET /identity/v3/role_assignments?user.id=906cb6e2f74d4b969d63e106b620b38b&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:50.414213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:50.415341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291a6d4-7865-46e8-a49f-850b714034b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.416771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a6d4-7865-46e8-a49f-850b714034b7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.417650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a6d4-7865-46e8-a49f-850b714034b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.419094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a6d4-7865-46e8-a49f-850b714034b7 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.420651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291a6d4-7865-46e8-a49f-850b714034b7 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.422462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291a6d4-7865-46e8-a49f-850b714034b7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.433199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 105/203] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:50 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:50.433937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291a6d4-7865-46e8-a49f-850b714034b7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:50.553647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291a6d4-7865-46e8-a49f-850b714034b7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.558143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52786d9-69e0-4cbf-bbb3-b8a87488ad41 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.589479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:50.598883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.600106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.600641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.601247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.602909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] RBAC: Adding query filter params (role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=28150185d6e141fcb8b89982937b34cb, user.id=906cb6e2f74d4b969d63e106b620b38b) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:50.604206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.605939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.619140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 106/204] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:50 2022] GET /identity/v3/role_assignments?user.id=906cb6e2f74d4b969d63e106b620b38b&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=0e7d21c594094cef90457df82be0bce6 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:50.629427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bd303-fcf4-4f56-9de5-81c7d8be11af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.630638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bd303-fcf4-4f56-9de5-81c7d8be11af None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.631119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bd303-fcf4-4f56-9de5-81c7d8be11af None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.631576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bd303-fcf4-4f56-9de5-81c7d8be11af None admin] PATH_INFO: `/v3/users/c3f1d9acb16f4432af7205dd5f8cb2b0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.632965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bd303-fcf4-4f56-9de5-81c7d8be11af None admin] RBAC: Authorizing `identity:get_user(user_id=c3f1d9acb16f4432af7205dd5f8cb2b0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.634710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bd303-fcf4-4f56-9de5-81c7d8be11af None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.642423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:50.643554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 99/205] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:50 2022] GET /identity/v3/users/c3f1d9acb16f4432af7205dd5f8cb2b0 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:50.655055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:50.767707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef4523-5b3c-413a-8123-290ea4ce27a1 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.816161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f0cf9-a082-4761-9072-4001ceb04600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.816780 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f0cf9-a082-4761-9072-4001ceb04600 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.817056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f0cf9-a082-4761-9072-4001ceb04600 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.817326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f0cf9-a082-4761-9072-4001ceb04600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.896911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f0cf9-a082-4761-9072-4001ceb04600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.898355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f0cf9-a082-4761-9072-4001ceb04600 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.907850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:51.030560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 107/206] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:51.036870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bd303-fcf4-4f56-9de5-81c7d8be11af None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:51.159537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bd303-fcf4-4f56-9de5-81c7d8be11af None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:51.195211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3da248-b7a2-4a95-9615-ceaa63fbe655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:51.195856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da248-b7a2-4a95-9615-ceaa63fbe655 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:51.196134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da248-b7a2-4a95-9615-ceaa63fbe655 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:51.196408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da248-b7a2-4a95-9615-ceaa63fbe655 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:51.198124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3da248-b7a2-4a95-9615-ceaa63fbe655 None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:51.199576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3da248-b7a2-4a95-9615-ceaa63fbe655 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:51.201207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 100/207] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:51 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:51.207183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f0cf9-a082-4761-9072-4001ceb04600 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:51.350075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f0cf9-a082-4761-9072-4001ceb04600 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:51.364097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:51.410445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a50925-1b07-428b-852f-8eb24ba94c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:51.411054 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50925-1b07-428b-852f-8eb24ba94c6a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:51.411336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50925-1b07-428b-852f-8eb24ba94c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:51.411607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50925-1b07-428b-852f-8eb24ba94c6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:51.412353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a50925-1b07-428b-852f-8eb24ba94c6a None admin] RBAC: Adding query filter params (role.id=a41ebaad7f8e43ef8c749ed1f26c5d64, scope.project.id=e13bb57123f8483b9d6f24c63738d6be, user.id=c3f1d9acb16f4432af7205dd5f8cb2b0) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:51.412652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a50925-1b07-428b-852f-8eb24ba94c6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:51.414135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a50925-1b07-428b-852f-8eb24ba94c6a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:51.420919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 108/208] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:51 2022] GET /identity/v3/role_assignments?user.id=c3f1d9acb16f4432af7205dd5f8cb2b0&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:51.864046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e368f-d621-48a1-8302-b7ddbf744c92 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:51.864594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e368f-d621-48a1-8302-b7ddbf744c92 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:51.864594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e368f-d621-48a1-8302-b7ddbf744c92 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:51.866309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 101/209] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:51.872057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84212cd0-7e21-483b-b664-73325be73ff8 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:51.872572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84212cd0-7e21-483b-b664-73325be73ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:51.883140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84212cd0-7e21-483b-b664-73325be73ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:51.939498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-84212cd0-7e21-483b-b664-73325be73ff8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:51.941513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-84212cd0-7e21-483b-b664-73325be73ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:51.967851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ad84-cd21-49d9-9026-dc5aee920cf5 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:51.968167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ad84-cd21-49d9-9026-dc5aee920cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:51.968400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5ad84-cd21-49d9-9026-dc5aee920cf5 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:51.969889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 102/210] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:51.976499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdca3-7e53-4022-a014-1772047b6abe None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:51.976806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdca3-7e53-4022-a014-1772047b6abe None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:51.977051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdca3-7e53-4022-a014-1772047b6abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.005120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5bffdca3-7e53-4022-a014-1772047b6abe None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:52.006330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5bffdca3-7e53-4022-a014-1772047b6abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:52.046546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 109/211] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:52.065962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:52.084127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 103/212] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:52.315701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84212cd0-7e21-483b-b664-73325be73ff8 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:52.366593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffdca3-7e53-4022-a014-1772047b6abe None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:52.437530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:52.441928 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84212cd0-7e21-483b-b664-73325be73ff8 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:52.476400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffdca3-7e53-4022-a014-1772047b6abe None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:52.489124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8fced-19d9-4919-87d7-66608c3249b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:52.489868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8fced-19d9-4919-87d7-66608c3249b3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.490204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8fced-19d9-4919-87d7-66608c3249b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.490544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8fced-19d9-4919-87d7-66608c3249b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.502023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8fced-19d9-4919-87d7-66608c3249b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-c0f8fced-19d9-4919-87d7-66608c3249b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:52.506826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:52.507700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:52.508495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 110/213] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:52.515501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8fced-19d9-4919-87d7-66608c3249b3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:52.522260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ead44-716a-42b7-829a-671c93a24dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:52.523109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ead44-716a-42b7-829a-671c93a24dbe None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.523540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ead44-716a-42b7-829a-671c93a24dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.523963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ead44-716a-42b7-829a-671c93a24dbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.525241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ead44-716a-42b7-829a-671c93a24dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:52.527360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ead44-716a-42b7-829a-671c93a24dbe None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:52.530103 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 104/214] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:52.535249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ead44-716a-42b7-829a-671c93a24dbe None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:52.607473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:52.648836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8fced-19d9-4919-87d7-66608c3249b3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:52.669600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ead44-716a-42b7-829a-671c93a24dbe None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:52.693216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb48799-acca-45cb-9745-86dbf6d079ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:52.694285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb48799-acca-45cb-9745-86dbf6d079ba None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.694786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb48799-acca-45cb-9745-86dbf6d079ba None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.695260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb48799-acca-45cb-9745-86dbf6d079ba None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.696230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb48799-acca-45cb-9745-86dbf6d079ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:52.696823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb48799-acca-45cb-9745-86dbf6d079ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:52.698512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb48799-acca-45cb-9745-86dbf6d079ba None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:52.708096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517bf81-032e-4388-bfb1-6e0c7abaefb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:52.708705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517bf81-032e-4388-bfb1-6e0c7abaefb3 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.708981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517bf81-032e-4388-bfb1-6e0c7abaefb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.709303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517bf81-032e-4388-bfb1-6e0c7abaefb3 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.709680 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 111/215] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:52.709993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517bf81-032e-4388-bfb1-6e0c7abaefb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:52.711264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c461d-1a3f-4211-9a58-766806421991 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.711439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517bf81-032e-4388-bfb1-6e0c7abaefb3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:52.711822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c461d-1a3f-4211-9a58-766806421991 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.712235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c461d-1a3f-4211-9a58-766806421991 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.714279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 112/216] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:52.718412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c461d-1a3f-4211-9a58-766806421991 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:52.744802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:52.806562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 105/217] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:15:52 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:52.815355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a341b2-6311-4965-81c1-6234bfd291b7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.815947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a341b2-6311-4965-81c1-6234bfd291b7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.816298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a341b2-6311-4965-81c1-6234bfd291b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.828139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c461d-1a3f-4211-9a58-766806421991 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:52.839986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b2a341b2-6311-4965-81c1-6234bfd291b7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:52.841707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b2a341b2-6311-4965-81c1-6234bfd291b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:52.870706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483ee8-6bb6-4905-8e84-bd993155fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:52.871326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483ee8-6bb6-4905-8e84-bd993155fa62 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.871602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483ee8-6bb6-4905-8e84-bd993155fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.871869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483ee8-6bb6-4905-8e84-bd993155fa62 None admin] PATH_INFO: `/v3/users/dcf0f1e1c078417aa66e9e6e251c5e2c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.887692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d483ee8-6bb6-4905-8e84-bd993155fa62 None admin] RBAC: Authorizing `identity:get_user(user_id=dcf0f1e1c078417aa66e9e6e251c5e2c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:52.889353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d483ee8-6bb6-4905-8e84-bd993155fa62 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:52.891284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 113/218] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:52 2022] GET /identity/v3/users/dcf0f1e1c078417aa66e9e6e251c5e2c => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:52.892481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69628d-61d6-4f80-a657-eb2b9e34c7a1 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.892771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69628d-61d6-4f80-a657-eb2b9e34c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.893080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69628d-61d6-4f80-a657-eb2b9e34c7a1 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.894474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 114/219] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:52.898622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69628d-61d6-4f80-a657-eb2b9e34c7a1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:52.923076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 106/220] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:52.924853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68315-d91e-4770-bd7d-cda1ddd1baed None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.925158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68315-d91e-4770-bd7d-cda1ddd1baed None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.925439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68315-d91e-4770-bd7d-cda1ddd1baed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.950544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-19b68315-d91e-4770-bd7d-cda1ddd1baed None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:52.951765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-19b68315-d91e-4770-bd7d-cda1ddd1baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:52.996575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:53.014827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:53.043772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69628d-61d6-4f80-a657-eb2b9e34c7a1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:53.052174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 107/221] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:53.088971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17cb84-1383-4398-b62c-e2662758c99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:53.089851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17cb84-1383-4398-b62c-e2662758c99f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:53.090272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17cb84-1383-4398-b62c-e2662758c99f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:53.090712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17cb84-1383-4398-b62c-e2662758c99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:53.164647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17cb84-1383-4398-b62c-e2662758c99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:53.166652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17cb84-1383-4398-b62c-e2662758c99f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:53.189393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b68315-d91e-4770-bd7d-cda1ddd1baed None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:53.290530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 115/222] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:53.291605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:53.298289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17cb84-1383-4398-b62c-e2662758c99f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:53.324540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b68315-d91e-4770-bd7d-cda1ddd1baed None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:53.374023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333078-1401-4b9c-8027-dcc15daba3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:53.374917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333078-1401-4b9c-8027-dcc15daba3df None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:53.375216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333078-1401-4b9c-8027-dcc15daba3df None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:53.375485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333078-1401-4b9c-8027-dcc15daba3df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:53.390637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80333078-1401-4b9c-8027-dcc15daba3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-80333078-1401-4b9c-8027-dcc15daba3df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:53.395965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:53.396857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:53.397665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:53.399940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 108/223] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:53.406118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333078-1401-4b9c-8027-dcc15daba3df None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:53.425833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17cb84-1383-4398-b62c-e2662758c99f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:53.437699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:53.474792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e185-7b0d-4679-9515-778984dddcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:53.475431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e185-7b0d-4679-9515-778984dddcb7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:53.475709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e185-7b0d-4679-9515-778984dddcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:53.475979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4e185-7b0d-4679-9515-778984dddcb7 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:53.477488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4e185-7b0d-4679-9515-778984dddcb7 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:53.479290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4e185-7b0d-4679-9515-778984dddcb7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:53.481101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 116/224] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:53 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:53.486421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e185-7b0d-4679-9515-778984dddcb7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:53.533748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333078-1401-4b9c-8027-dcc15daba3df None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:53.540887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:53.584308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2cf32-8a60-4300-8cb9-832e3f06a902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:53.585863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2cf32-8a60-4300-8cb9-832e3f06a902 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:53.586742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2cf32-8a60-4300-8cb9-832e3f06a902 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:53.588133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2cf32-8a60-4300-8cb9-832e3f06a902 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:53.596972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4e185-7b0d-4679-9515-778984dddcb7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:53.607612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2cf32-8a60-4300-8cb9-832e3f06a902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a1e2cf32-8a60-4300-8cb9-832e3f06a902 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:53.616919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:53.617876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:53.618708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:53.621517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 109/225] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:53.622554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2cf32-8a60-4300-8cb9-832e3f06a902 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:53.635674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:53.636296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:53.636576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:53.636849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:53.637515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:53.637861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:53.639241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:53.649180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 117/226] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:53.650550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:53.747996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:53.760606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2cf32-8a60-4300-8cb9-832e3f06a902 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:53.767127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962a09-0393-4cc7-9232-098be08352e5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:53.780175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:53.795194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:53.796089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:53.796589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:53.797062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:53.798022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] RBAC: Adding query filter params (role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=28150185d6e141fcb8b89982937b34cb, user.id=dcf0f1e1c078417aa66e9e6e251c5e2c) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:53.798551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:53.800192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:53.813638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:53.813638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:53.813638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:53.813638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:53.822602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:53.822602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:53.822602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:53.822813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 110/227] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:53 2022] GET /identity/v3/role_assignments?user.id=dcf0f1e1c078417aa66e9e6e251c5e2c&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:53.822813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:53.826328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 118/228] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:53.832874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:53.954507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc83bb5-e444-4787-8ae3-12b5edf0b3e3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:54.001729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478807-d68e-42ec-b2e8-e2f86b7a887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:54.001729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478807-d68e-42ec-b2e8-e2f86b7a887c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.001729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478807-d68e-42ec-b2e8-e2f86b7a887c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.001729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f478807-d68e-42ec-b2e8-e2f86b7a887c None admin] PATH_INFO: `/v3/users/906cb6e2f74d4b969d63e106b620b38b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.002124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478807-d68e-42ec-b2e8-e2f86b7a887c None admin] RBAC: Authorizing `identity:get_user(user_id=906cb6e2f74d4b969d63e106b620b38b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:54.002124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f478807-d68e-42ec-b2e8-e2f86b7a887c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:54.002124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 119/229] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:53 2022] GET /identity/v3/users/906cb6e2f74d4b969d63e106b620b38b => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:54.007808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478807-d68e-42ec-b2e8-e2f86b7a887c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:54.058036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:54.059616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7484a0f-3644-4777-889e-1af53c9053df None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:54.107311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9e47-26d9-465b-95d8-6afb1119e1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:54.108053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9e47-26d9-465b-95d8-6afb1119e1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.108406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9e47-26d9-465b-95d8-6afb1119e1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.108770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9e47-26d9-465b-95d8-6afb1119e1a8 None admin] PATH_INFO: `/v3/users/906cb6e2f74d4b969d63e106b620b38b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.110013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9e47-26d9-465b-95d8-6afb1119e1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=906cb6e2f74d4b969d63e106b620b38b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:54.111804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9e47-26d9-465b-95d8-6afb1119e1a8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:54.114349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 111/230] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:53 2022] GET /identity/v3/users/906cb6e2f74d4b969d63e106b620b38b => generated 283 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:54.121780 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f478807-d68e-42ec-b2e8-e2f86b7a887c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:54.123085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9e47-26d9-465b-95d8-6afb1119e1a8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:54.166022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:54.201350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4548e7-5a7e-422e-965d-25b8e68c1288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:54.202078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4548e7-5a7e-422e-965d-25b8e68c1288 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.202422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4548e7-5a7e-422e-965d-25b8e68c1288 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.202798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4548e7-5a7e-422e-965d-25b8e68c1288 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.206229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4548e7-5a7e-422e-965d-25b8e68c1288 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:54.207816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4548e7-5a7e-422e-965d-25b8e68c1288 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:54.209508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 120/231] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:54 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:54.215634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4548e7-5a7e-422e-965d-25b8e68c1288 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:54.300218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9e47-26d9-465b-95d8-6afb1119e1a8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:54.349849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4548e7-5a7e-422e-965d-25b8e68c1288 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:54.360936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:54.386884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243390da-31fb-4267-8412-6cdd396ef0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:54.387565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243390da-31fb-4267-8412-6cdd396ef0ff None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.387842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243390da-31fb-4267-8412-6cdd396ef0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.388117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243390da-31fb-4267-8412-6cdd396ef0ff None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb/users/906cb6e2f74d4b969d63e106b620b38b/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.390132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243390da-31fb-4267-8412-6cdd396ef0ff None admin] RBAC: Authorizing `identity:create_grant(project_id=28150185d6e141fcb8b89982937b34cb, user_id=906cb6e2f74d4b969d63e106b620b38b, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:54.392045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243390da-31fb-4267-8412-6cdd396ef0ff None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:54.401967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4e22a-4f60-44e7-875d-000ca047c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:54.402608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4e22a-4f60-44e7-875d-000ca047c26e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.402943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4e22a-4f60-44e7-875d-000ca047c26e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.403224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4e22a-4f60-44e7-875d-000ca047c26e None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.404453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4e22a-4f60-44e7-875d-000ca047c26e None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:54.405999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4e22a-4f60-44e7-875d-000ca047c26e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:54.408093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 112/232] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:54 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:54.413401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4e22a-4f60-44e7-875d-000ca047c26e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:54.480008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 121/233] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:54 2022] PUT /identity/v3/projects/28150185d6e141fcb8b89982937b34cb/users/906cb6e2f74d4b969d63e106b620b38b/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:15:54.524357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:54.540449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4e22a-4f60-44e7-875d-000ca047c26e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:54.580914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e339ac-180a-42a4-b83d-8c02816ea17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:54.581671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e339ac-180a-42a4-b83d-8c02816ea17f None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.581966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e339ac-180a-42a4-b83d-8c02816ea17f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.582242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e339ac-180a-42a4-b83d-8c02816ea17f None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb/users/906cb6e2f74d4b969d63e106b620b38b/roles/0e7d21c594094cef90457df82be0bce6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.584494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e339ac-180a-42a4-b83d-8c02816ea17f None admin] RBAC: Authorizing `identity:create_grant(project_id=28150185d6e141fcb8b89982937b34cb, user_id=906cb6e2f74d4b969d63e106b620b38b, role_id=0e7d21c594094cef90457df82be0bce6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:54.585965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e339ac-180a-42a4-b83d-8c02816ea17f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:54.710039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 113/234] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:54 2022] PUT /identity/v3/projects/28150185d6e141fcb8b89982937b34cb/users/906cb6e2f74d4b969d63e106b620b38b/roles/0e7d21c594094cef90457df82be0bce6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:55.104730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d05fd-31c1-489f-903b-34388e2e3e76 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.104730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d05fd-31c1-489f-903b-34388e2e3e76 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.104730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d05fd-31c1-489f-903b-34388e2e3e76 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.104730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 122/235] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:55.111422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537fed-49b9-4265-91ee-c5b34eef247b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.112227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537fed-49b9-4265-91ee-c5b34eef247b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.112699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2537fed-49b9-4265-91ee-c5b34eef247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.130821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e2537fed-49b9-4265-91ee-c5b34eef247b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:55.132336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e2537fed-49b9-4265-91ee-c5b34eef247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:55.194561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b7e1-974b-4bfa-8fa2-39895861d55c None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.194886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b7e1-974b-4bfa-8fa2-39895861d55c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.195111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4b7e1-974b-4bfa-8fa2-39895861d55c None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.197220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 123/236] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:55.202150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046f9cc-80b1-443f-8c5a-e82cc138d07a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.202437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046f9cc-80b1-443f-8c5a-e82cc138d07a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.202712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046f9cc-80b1-443f-8c5a-e82cc138d07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.226806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e046f9cc-80b1-443f-8c5a-e82cc138d07a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:55.228174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e046f9cc-80b1-443f-8c5a-e82cc138d07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:55.267893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 114/237] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:55.303012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 124/238] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:55.620125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2537fed-49b9-4265-91ee-c5b34eef247b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:55.629649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046f9cc-80b1-443f-8c5a-e82cc138d07a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:55.757967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:55.778954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2537fed-49b9-4265-91ee-c5b34eef247b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:55.811134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:55.815575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840f233-f38b-471e-93e8-5612f222c92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:55.816226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f233-f38b-471e-93e8-5612f222c92f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.816512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f233-f38b-471e-93e8-5612f222c92f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.816789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f233-f38b-471e-93e8-5612f222c92f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.817952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840f233-f38b-471e-93e8-5612f222c92f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:55.819555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840f233-f38b-471e-93e8-5612f222c92f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:55.819751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046f9cc-80b1-443f-8c5a-e82cc138d07a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:55.821566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 115/239] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:55.828564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840f233-f38b-471e-93e8-5612f222c92f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:55.898451 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccfd9-d2ea-4bcb-bf63-f4f49e05f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:55.899413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccfd9-d2ea-4bcb-bf63-f4f49e05f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.899874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccfd9-d2ea-4bcb-bf63-f4f49e05f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.900358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccfd9-d2ea-4bcb-bf63-f4f49e05f7d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.919644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cccfd9-d2ea-4bcb-bf63-f4f49e05f7d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-66cccfd9-d2ea-4bcb-bf63-f4f49e05f7d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:55.934532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:55.935471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:15:55.936302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:55.938767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 125/240] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:55.941359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840f233-f38b-471e-93e8-5612f222c92f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:55.944131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccfd9-d2ea-4bcb-bf63-f4f49e05f7d3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:55.980467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ee36-8429-4acd-abb4-2bc556905faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:55.981081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ee36-8429-4acd-abb4-2bc556905faa None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.981365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ee36-8429-4acd-abb4-2bc556905faa None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.981695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ee36-8429-4acd-abb4-2bc556905faa None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.982355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0ee36-8429-4acd-abb4-2bc556905faa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:55.983928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0ee36-8429-4acd-abb4-2bc556905faa None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:56.063895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 116/241] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:15:55 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:15:56.096876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccfd9-d2ea-4bcb-bf63-f4f49e05f7d3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:56.145571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:56.146245 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:56.146537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:56.146816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:56.147596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:56.147900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:56.149634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:56.159773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 126/242] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:56.166844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ee36-8429-4acd-abb4-2bc556905faa None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:56.169807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:56.298942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ee36-8429-4acd-abb4-2bc556905faa None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:56.335304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca6855-5769-49e3-8716-1c0796fb741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:56.335952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6855-5769-49e3-8716-1c0796fb741f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:56.336234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6855-5769-49e3-8716-1c0796fb741f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:56.336510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6855-5769-49e3-8716-1c0796fb741f None admin] PATH_INFO: `/v3/users/da2880cd543648c3bb02bdc967be0c35` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:56.350481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca6855-5769-49e3-8716-1c0796fb741f None admin] RBAC: Authorizing `identity:get_user(user_id=da2880cd543648c3bb02bdc967be0c35)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:56.352020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca6855-5769-49e3-8716-1c0796fb741f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:56.354234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 117/243] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:56 2022] GET /identity/v3/users/da2880cd543648c3bb02bdc967be0c35 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:56.359919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:56.386164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:56.439688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b0d26-30ff-4064-9f98-d49af2c9b094 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:56.439987 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b0d26-30ff-4064-9f98-d49af2c9b094 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:56.440164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b0d26-30ff-4064-9f98-d49af2c9b094 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:56.441505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 118/244] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:56.451064 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778944-1232-4f71-b85a-77ae6ea26a93 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:56.451358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778944-1232-4f71-b85a-77ae6ea26a93 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:56.451622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d778944-1232-4f71-b85a-77ae6ea26a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:56.472948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0d778944-1232-4f71-b85a-77ae6ea26a93 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:56.474347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0d778944-1232-4f71-b85a-77ae6ea26a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:56.481784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc8f5b-4446-4bf8-adf0-0e4a8bdab1a1 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:56.528341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ff74e-4c61-4b08-9457-8c2c365297db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:56.528962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff74e-4c61-4b08-9457-8c2c365297db None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:56.529240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff74e-4c61-4b08-9457-8c2c365297db None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:56.529508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff74e-4c61-4b08-9457-8c2c365297db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:56.551646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:56.566855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 119/245] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:56.617962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ff74e-4c61-4b08-9457-8c2c365297db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:56.619513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ff74e-4c61-4b08-9457-8c2c365297db None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:56.643392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:56.739671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 127/246] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:56.745165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d778944-1232-4f71-b85a-77ae6ea26a93 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:56.855112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d778944-1232-4f71-b85a-77ae6ea26a93 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:56.892967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6844d-b859-4def-bf38-874ce8f171dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:56.894068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6844d-b859-4def-bf38-874ce8f171dd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:56.894544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6844d-b859-4def-bf38-874ce8f171dd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:56.894998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6844d-b859-4def-bf38-874ce8f171dd None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:56.896303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6844d-b859-4def-bf38-874ce8f171dd None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:56.898020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6844d-b859-4def-bf38-874ce8f171dd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:56.900240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 120/247] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:56 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:56.905854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ff74e-4c61-4b08-9457-8c2c365297db None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:56.920736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6844d-b859-4def-bf38-874ce8f171dd None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.007418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:57.035827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ff74e-4c61-4b08-9457-8c2c365297db None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.058615 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:57.060110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6844d-b859-4def-bf38-874ce8f171dd None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.075309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a431c-dc7c-4d9e-a9ca-3db6d5f4cfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:57.076277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a431c-dc7c-4d9e-a9ca-3db6d5f4cfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.077120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a431c-dc7c-4d9e-a9ca-3db6d5f4cfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.077510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a431c-dc7c-4d9e-a9ca-3db6d5f4cfb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.078487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a431c-dc7c-4d9e-a9ca-3db6d5f4cfb2 None admin] RBAC: Adding query filter params (role.id=a41ebaad7f8e43ef8c749ed1f26c5d64, scope.project.id=28150185d6e141fcb8b89982937b34cb, user.id=da2880cd543648c3bb02bdc967be0c35) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:57.079032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a431c-dc7c-4d9e-a9ca-3db6d5f4cfb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:57.080879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a431c-dc7c-4d9e-a9ca-3db6d5f4cfb2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:57.087469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 128/248] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:56 2022] GET /identity/v3/role_assignments?user.id=da2880cd543648c3bb02bdc967be0c35&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:57.088978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58ccf-2f63-4477-9eb6-36dfc639deae None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.089461 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58ccf-2f63-4477-9eb6-36dfc639deae None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.090016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58ccf-2f63-4477-9eb6-36dfc639deae None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.091675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 129/249] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:57.093296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c94c-1ce3-4d23-b7ee-cf045775391c None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.093847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c94c-1ce3-4d23-b7ee-cf045775391c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.094315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c94c-1ce3-4d23-b7ee-cf045775391c None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.096098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 130/250] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:57.097490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee2c51-86f8-4f7c-a23e-9e0761bd409b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.097985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee2c51-86f8-4f7c-a23e-9e0761bd409b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.098501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee2c51-86f8-4f7c-a23e-9e0761bd409b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.113104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411369d-f3dc-4ff3-80f0-08ebb52db50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:57.114355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411369d-f3dc-4ff3-80f0-08ebb52db50a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.114854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411369d-f3dc-4ff3-80f0-08ebb52db50a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.116696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411369d-f3dc-4ff3-80f0-08ebb52db50a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.137253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-68ee2c51-86f8-4f7c-a23e-9e0761bd409b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:57.139956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-68ee2c51-86f8-4f7c-a23e-9e0761bd409b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:57.144725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411369d-f3dc-4ff3-80f0-08ebb52db50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f411369d-f3dc-4ff3-80f0-08ebb52db50a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:57.155622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:57.156579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:15:57.157375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:15:57.162275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 121/251] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:57.163853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e860ab-1c90-48d1-a4ac-b8d0df56693f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.165711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e860ab-1c90-48d1-a4ac-b8d0df56693f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.168837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e860ab-1c90-48d1-a4ac-b8d0df56693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.206665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-72e860ab-1c90-48d1-a4ac-b8d0df56693f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:57.210961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-72e860ab-1c90-48d1-a4ac-b8d0df56693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:57.275864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 131/252] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:57.277433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee2c51-86f8-4f7c-a23e-9e0761bd409b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.309580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 122/253] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:15:57.385459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee2c51-86f8-4f7c-a23e-9e0761bd409b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.401469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:57.422383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:57.423292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.426430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.426430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.426430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] RBAC: Adding query filter params (name=member) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:57.426430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:57.426911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:57.435448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 132/254] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:15:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:57.441274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e860ab-1c90-48d1-a4ac-b8d0df56693f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.512838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:57.574163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e860ab-1c90-48d1-a4ac-b8d0df56693f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.608892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec395399-4723-4974-8fc4-986c8bc5b64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:57.610012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395399-4723-4974-8fc4-986c8bc5b64e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.610291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395399-4723-4974-8fc4-986c8bc5b64e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.610572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395399-4723-4974-8fc4-986c8bc5b64e None admin] PATH_INFO: `/v3/users/dcf0f1e1c078417aa66e9e6e251c5e2c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.611976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec395399-4723-4974-8fc4-986c8bc5b64e None admin] RBAC: Authorizing `identity:get_user(user_id=dcf0f1e1c078417aa66e9e6e251c5e2c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:57.613430 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec395399-4723-4974-8fc4-986c8bc5b64e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:57.615346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 123/255] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:57 2022] GET /identity/v3/users/dcf0f1e1c078417aa66e9e6e251c5e2c => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:57.620887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.749120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b52a4-e655-40ba-8ffb-f50792d6e742 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.793283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf70221-0441-4c58-a2c4-0896d0d570a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:57.794234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70221-0441-4c58-a2c4-0896d0d570a6 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.794722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70221-0441-4c58-a2c4-0896d0d570a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.795224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70221-0441-4c58-a2c4-0896d0d570a6 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.796528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf70221-0441-4c58-a2c4-0896d0d570a6 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:57.798221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf70221-0441-4c58-a2c4-0896d0d570a6 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:57.800315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 133/256] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:57 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:57.806131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec395399-4723-4974-8fc4-986c8bc5b64e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.854924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf70221-0441-4c58-a2c4-0896d0d570a6 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.909919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:57.967810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec395399-4723-4974-8fc4-986c8bc5b64e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.984215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf70221-0441-4c58-a2c4-0896d0d570a6 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.005287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:58.020624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31296f0-615a-4a31-9769-d00330da1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.021258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31296f0-615a-4a31-9769-d00330da1543 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.021537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31296f0-615a-4a31-9769-d00330da1543 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.021837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31296f0-615a-4a31-9769-d00330da1543 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.038426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31296f0-615a-4a31-9769-d00330da1543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-f31296f0-615a-4a31-9769-d00330da1543 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:58.043816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:58.044812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:15:58.045814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:58.048025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 134/257] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:15:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:58.048990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31296f0-615a-4a31-9769-d00330da1543 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.062905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a1d0e-c9a2-46eb-b9df-4d575d7cb715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.063615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1d0e-c9a2-46eb-b9df-4d575d7cb715 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.063884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1d0e-c9a2-46eb-b9df-4d575d7cb715 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.064165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a1d0e-c9a2-46eb-b9df-4d575d7cb715 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb/users/dcf0f1e1c078417aa66e9e6e251c5e2c/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.066143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a1d0e-c9a2-46eb-b9df-4d575d7cb715 None admin] RBAC: Authorizing `identity:create_grant(project_id=28150185d6e141fcb8b89982937b34cb, user_id=dcf0f1e1c078417aa66e9e6e251c5e2c, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:58.067605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a1d0e-c9a2-46eb-b9df-4d575d7cb715 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:58.161316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31296f0-615a-4a31-9769-d00330da1543 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.163901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:58.193151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 124/258] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:57 2022] PUT /identity/v3/projects/28150185d6e141fcb8b89982937b34cb/users/dcf0f1e1c078417aa66e9e6e251c5e2c/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:58.196523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b73db-921d-4ae7-a73f-20bd3ed46edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.197730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b73db-921d-4ae7-a73f-20bd3ed46edd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.198038 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b73db-921d-4ae7-a73f-20bd3ed46edd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.198360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b73db-921d-4ae7-a73f-20bd3ed46edd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.198576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a1d0e-c9a2-46eb-b9df-4d575d7cb715 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.213668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b73db-921d-4ae7-a73f-20bd3ed46edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-776b73db-921d-4ae7-a73f-20bd3ed46edd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:58.217413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:58.218346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:15:58.219141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 135/259] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:58.222751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b73db-921d-4ae7-a73f-20bd3ed46edd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.320701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a1d0e-c9a2-46eb-b9df-4d575d7cb715 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.329230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b73db-921d-4ae7-a73f-20bd3ed46edd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.357842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.358819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.359303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.359835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.360733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:58.361555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:58.363150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:58.365454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.366589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.366997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.367342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.368104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:58.368481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:58.370599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:58.374662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 125/260] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:58.380128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.381080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 136/261] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:58.387766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.417070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:58.462336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:58.505089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19c977-7e1e-4bfa-8c12-122618036647 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.547913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679676e-1edf-4532-8c4b-dc4494b4b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.549011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679676e-1edf-4532-8c4b-dc4494b4b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.549497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679676e-1edf-4532-8c4b-dc4494b4b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.549989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679676e-1edf-4532-8c4b-dc4494b4b0e7 None admin] PATH_INFO: `/v3/users/906cb6e2f74d4b969d63e106b620b38b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.551617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679676e-1edf-4532-8c4b-dc4494b4b0e7 None admin] RBAC: Authorizing `identity:get_user(user_id=906cb6e2f74d4b969d63e106b620b38b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:58.553155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679676e-1edf-4532-8c4b-dc4494b4b0e7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:58.554996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 137/262] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/users/906cb6e2f74d4b969d63e106b620b38b => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:58.561583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679676e-1edf-4532-8c4b-dc4494b4b0e7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.568749 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f0d3f-4b4b-48dc-b8f8-615699b110fe None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.606845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d365332-37b0-4128-8cc4-fbabcb64b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.608164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d365332-37b0-4128-8cc4-fbabcb64b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.608947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d365332-37b0-4128-8cc4-fbabcb64b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.609439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d365332-37b0-4128-8cc4-fbabcb64b3c4 None admin] PATH_INFO: `/v3/users/906cb6e2f74d4b969d63e106b620b38b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.611259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d365332-37b0-4128-8cc4-fbabcb64b3c4 None admin] RBAC: Authorizing `identity:get_user(user_id=906cb6e2f74d4b969d63e106b620b38b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:58.613320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d365332-37b0-4128-8cc4-fbabcb64b3c4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:58.615587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 126/263] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/users/906cb6e2f74d4b969d63e106b620b38b => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:58.623235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d365332-37b0-4128-8cc4-fbabcb64b3c4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.680805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:58.688432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679676e-1edf-4532-8c4b-dc4494b4b0e7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.723758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf23d0-0161-4f0f-b4d1-5d86adb27e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.724795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf23d0-0161-4f0f-b4d1-5d86adb27e0a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.726317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf23d0-0161-4f0f-b4d1-5d86adb27e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.726835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf23d0-0161-4f0f-b4d1-5d86adb27e0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.800287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf23d0-0161-4f0f-b4d1-5d86adb27e0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:58.802243 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf23d0-0161-4f0f-b4d1-5d86adb27e0a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:58.833345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d365332-37b0-4128-8cc4-fbabcb64b3c4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.843552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:58.902073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:58.910316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 138/264] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:15:58.916048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf23d0-0161-4f0f-b4d1-5d86adb27e0a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.919799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b164f-7f40-4f08-a0d2-4d9d8413a997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.920191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b164f-7f40-4f08-a0d2-4d9d8413a997 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.920476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b164f-7f40-4f08-a0d2-4d9d8413a997 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.920756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b164f-7f40-4f08-a0d2-4d9d8413a997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.023777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf23d0-0161-4f0f-b4d1-5d86adb27e0a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:59.068378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b164f-7f40-4f08-a0d2-4d9d8413a997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:59.070142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b164f-7f40-4f08-a0d2-4d9d8413a997 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:59.072548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7f81b-4ae6-474c-b6c8-ec2207cb63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:59.073415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7f81b-4ae6-474c-b6c8-ec2207cb63d9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:59.073969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7f81b-4ae6-474c-b6c8-ec2207cb63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:59.074438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7f81b-4ae6-474c-b6c8-ec2207cb63d9 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.082965 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7f81b-4ae6-474c-b6c8-ec2207cb63d9 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:59.084683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7f81b-4ae6-474c-b6c8-ec2207cb63d9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:59.086668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 139/265] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:59.095310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7f81b-4ae6-474c-b6c8-ec2207cb63d9 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:59.171534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:59.211888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7f81b-4ae6-474c-b6c8-ec2207cb63d9 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:59.249795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dde13c-daa6-4ee2-9277-86650f1be588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:59.250762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde13c-daa6-4ee2-9277-86650f1be588 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:59.251264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde13c-daa6-4ee2-9277-86650f1be588 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:59.251731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde13c-daa6-4ee2-9277-86650f1be588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.252744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde13c-daa6-4ee2-9277-86650f1be588 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=28150185d6e141fcb8b89982937b34cb, user.id=906cb6e2f74d4b969d63e106b620b38b) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:59.253256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde13c-daa6-4ee2-9277-86650f1be588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:59.254923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde13c-daa6-4ee2-9277-86650f1be588 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:59.261340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 140/266] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:59 2022] GET /identity/v3/role_assignments?user.id=906cb6e2f74d4b969d63e106b620b38b&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:59.262745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575b90-a8b6-48ec-9059-392f13a6c440 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:59.263228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575b90-a8b6-48ec-9059-392f13a6c440 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:59.263713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88575b90-a8b6-48ec-9059-392f13a6c440 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.269631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 141/267] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:59.275210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2921-03c3-4c19-8057-1095307b2aa4 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:59.275803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2921-03c3-4c19-8057-1095307b2aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:59.276270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb2921-03c3-4c19-8057-1095307b2aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.307404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-adbb2921-03c3-4c19-8057-1095307b2aa4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:59.308976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-adbb2921-03c3-4c19-8057-1095307b2aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:59.324479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 127/268] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:15:59.330286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b164f-7f40-4f08-a0d2-4d9d8413a997 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:59.344210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:59.420856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 142/269] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:59.540109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b164f-7f40-4f08-a0d2-4d9d8413a997 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:59.578211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc8910-4739-47d3-b963-b861ddf3039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:59.578851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8910-4739-47d3-b963-b861ddf3039f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:59.579136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8910-4739-47d3-b963-b861ddf3039f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:59.579411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc8910-4739-47d3-b963-b861ddf3039f None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.580558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc8910-4739-47d3-b963-b861ddf3039f None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:59.582048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc8910-4739-47d3-b963-b861ddf3039f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:59.583682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 128/270] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:15:59 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:59.590324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb2921-03c3-4c19-8057-1095307b2aa4 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:59.679022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:59.720599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f538-b973-4321-aa26-8d0cd496f150 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:59.721244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f538-b973-4321-aa26-8d0cd496f150 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:59.721761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f538-b973-4321-aa26-8d0cd496f150 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.723292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 129/271] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:59.730304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ad63-4637-4a7e-9ccb-a7cac77b8221 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:59.730699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ad63-4637-4a7e-9ccb-a7cac77b8221 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:59.730974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ad63-4637-4a7e-9ccb-a7cac77b8221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.741074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb2921-03c3-4c19-8057-1095307b2aa4 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:59.758579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3a20ad63-4637-4a7e-9ccb-a7cac77b8221 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:59.761661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3a20ad63-4637-4a7e-9ccb-a7cac77b8221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:59.796737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:59.797272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:59.797551 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:59.797849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:59.798580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] RBAC: Adding query filter params (role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=28150185d6e141fcb8b89982937b34cb, user.id=906cb6e2f74d4b969d63e106b620b38b) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:59.798882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:59.800549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:59.807483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 143/272] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:59 2022] GET /identity/v3/role_assignments?user.id=906cb6e2f74d4b969d63e106b620b38b&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=0e7d21c594094cef90457df82be0bce6 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:59.809737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:59.892299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 130/273] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:15:59.989191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eb409-054e-4b0d-804e-632a3951b107 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:00.017847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:00.038988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4f7a-7228-4306-94ee-fec63ae1b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:00.039635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4f7a-7228-4306-94ee-fec63ae1b743 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.039919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4f7a-7228-4306-94ee-fec63ae1b743 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.040191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4f7a-7228-4306-94ee-fec63ae1b743 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.065295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b4f7a-7228-4306-94ee-fec63ae1b743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-cb9b4f7a-7228-4306-94ee-fec63ae1b743 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:00.070989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:00.071932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:00.072792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 144/274] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:00.079601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ad63-4637-4a7e-9ccb-a7cac77b8221 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:00.086648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:00.201490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4f7a-7228-4306-94ee-fec63ae1b743 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:00.202778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ad63-4637-4a7e-9ccb-a7cac77b8221 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:00.247906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feea6ab-62b9-4250-8dc1-520209ff50a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:00.248888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feea6ab-62b9-4250-8dc1-520209ff50a2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.249372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feea6ab-62b9-4250-8dc1-520209ff50a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.249934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feea6ab-62b9-4250-8dc1-520209ff50a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.250894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feea6ab-62b9-4250-8dc1-520209ff50a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:00.251369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feea6ab-62b9-4250-8dc1-520209ff50a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:00.252983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feea6ab-62b9-4250-8dc1-520209ff50a2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:00.263614 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 131/275] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:00.265325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1bc04-02f6-4d87-ac17-3390fb97c4b4 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.265839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1bc04-02f6-4d87-ac17-3390fb97c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.266315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1bc04-02f6-4d87-ac17-3390fb97c4b4 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.267806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 132/276] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:00.268740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1bc04-02f6-4d87-ac17-3390fb97c4b4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:00.328240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4f7a-7228-4306-94ee-fec63ae1b743 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:00.341136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:00.363843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57760c98-84d3-4740-8d1e-e2ce54eb9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:00.364487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760c98-84d3-4740-8d1e-e2ce54eb9d22 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.364767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760c98-84d3-4740-8d1e-e2ce54eb9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.365084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57760c98-84d3-4740-8d1e-e2ce54eb9d22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.366638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760c98-84d3-4740-8d1e-e2ce54eb9d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:00.368533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57760c98-84d3-4740-8d1e-e2ce54eb9d22 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:00.375624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 145/277] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:00.375624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e8c1c-7c25-4965-8f16-7960ce5b097c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.375624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e8c1c-7c25-4965-8f16-7960ce5b097c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.375624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e8c1c-7c25-4965-8f16-7960ce5b097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.379179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1bc04-02f6-4d87-ac17-3390fb97c4b4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:00.392941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-669e8c1c-7c25-4965-8f16-7960ce5b097c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:00.394244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-669e8c1c-7c25-4965-8f16-7960ce5b097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:00.414816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03a6bf-9394-470c-bfe1-ca05ad13d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:00.415446 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03a6bf-9394-470c-bfe1-ca05ad13d07d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.415904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03a6bf-9394-470c-bfe1-ca05ad13d07d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.416175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03a6bf-9394-470c-bfe1-ca05ad13d07d None admin] PATH_INFO: `/v3/users/2af1b6a8cfd3410cb93a78dfd81ee7e3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.430997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03a6bf-9394-470c-bfe1-ca05ad13d07d None admin] RBAC: Authorizing `identity:get_user(user_id=2af1b6a8cfd3410cb93a78dfd81ee7e3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:00.432977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03a6bf-9394-470c-bfe1-ca05ad13d07d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:00.439566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 133/278] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:00 2022] GET /identity/v3/users/2af1b6a8cfd3410cb93a78dfd81ee7e3 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:00.439566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03a6bf-9394-470c-bfe1-ca05ad13d07d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:00.443894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:00.477637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 146/279] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:00.477637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e8c1c-7c25-4965-8f16-7960ce5b097c None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:00.558082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03a6bf-9394-470c-bfe1-ca05ad13d07d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:00.585640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:00.597268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cdc7f-990c-4cff-9cb0-72100dec7984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:00.598264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cdc7f-990c-4cff-9cb0-72100dec7984 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.598407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cdc7f-990c-4cff-9cb0-72100dec7984 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.598682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cdc7f-990c-4cff-9cb0-72100dec7984 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.600272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cdc7f-990c-4cff-9cb0-72100dec7984 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:00.601086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cdc7f-990c-4cff-9cb0-72100dec7984 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:00.604758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e8c1c-7c25-4965-8f16-7960ce5b097c None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:00.643025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:00.643626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.643908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.644176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.644897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] RBAC: Adding query filter params (role.id=c2202fa3e5ce4430b5c100bfd6c74f21, user.id=2af1b6a8cfd3410cb93a78dfd81ee7e3, scope.system=all) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:00.645201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:00.646759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:00.652789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 147/280] 10.222.0.61 () {56 vars in 1308 bytes} [Tue Aug 23 16:16:00 2022] GET /identity/v3/role_assignments?user.id=2af1b6a8cfd3410cb93a78dfd81ee7e3&scope.system=all&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:00.711066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 134/281] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:16:00 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:00.760398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:00.797121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7453f-7573-4e4e-bb22-b1d58d72e01e None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.797478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7453f-7573-4e4e-bb22-b1d58d72e01e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.797722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7453f-7573-4e4e-bb22-b1d58d72e01e None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.799549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 135/282] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:00.805513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fc31c-b7c9-4545-8e3a-d54052fa81b4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.805847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fc31c-b7c9-4545-8e3a-d54052fa81b4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.806107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fc31c-b7c9-4545-8e3a-d54052fa81b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.823117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:00.829667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-173fc31c-b7c9-4545-8e3a-d54052fa81b4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:00.830933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-173fc31c-b7c9-4545-8e3a-d54052fa81b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:00.894168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815470-26d6-4d8b-853a-2b4ef2c24ae2 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:00.913384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 136/283] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:00.940336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7273c2-f879-4494-8218-c3eddede7f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:00.940971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7273c2-f879-4494-8218-c3eddede7f4c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:00.941249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7273c2-f879-4494-8218-c3eddede7f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:00.941516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7273c2-f879-4494-8218-c3eddede7f4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:00.953074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7273c2-f879-4494-8218-c3eddede7f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-0d7273c2-f879-4494-8218-c3eddede7f4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:00.958394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:00.959527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:00.960368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 148/284] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:00.969320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fc31c-b7c9-4545-8e3a-d54052fa81b4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:01.090334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fc31c-b7c9-4545-8e3a-d54052fa81b4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:01.103295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:01.129785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:01.130501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:01.130795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:01.131063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:01.131734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:01.132032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:01.133517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:01.143229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 137/285] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:01.148855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7273c2-f879-4494-8218-c3eddede7f4c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:01.193034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:01.277841 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7273c2-f879-4494-8218-c3eddede7f4c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:01.280537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:01.318741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1eb4f-cfab-4afa-92a1-bc624c83bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:01.319819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1eb4f-cfab-4afa-92a1-bc624c83bd85 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:01.320102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1eb4f-cfab-4afa-92a1-bc624c83bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:01.320376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1eb4f-cfab-4afa-92a1-bc624c83bd85 None admin] PATH_INFO: `/v3/users/da2880cd543648c3bb02bdc967be0c35` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:01.321750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1eb4f-cfab-4afa-92a1-bc624c83bd85 None admin] RBAC: Authorizing `identity:get_user(user_id=da2880cd543648c3bb02bdc967be0c35)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:01.323895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1eb4f-cfab-4afa-92a1-bc624c83bd85 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:01.325903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 149/286] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:01 2022] GET /identity/v3/users/da2880cd543648c3bb02bdc967be0c35 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:01.336013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1eb4f-cfab-4afa-92a1-bc624c83bd85 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:01.339194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcaaff-84ef-45d3-aadf-de4e77055cd4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:01.378483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15dda9-4e09-44ee-a1bb-78fa5e910ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:01.380674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15dda9-4e09-44ee-a1bb-78fa5e910ada None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:01.381803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15dda9-4e09-44ee-a1bb-78fa5e910ada None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:01.382296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15dda9-4e09-44ee-a1bb-78fa5e910ada None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:01.404755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15dda9-4e09-44ee-a1bb-78fa5e910ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-de15dda9-4e09-44ee-a1bb-78fa5e910ada None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:01.419927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:01.420849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:01.421660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:01.424252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 138/287] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:01.438916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15dda9-4e09-44ee-a1bb-78fa5e910ada None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:01.481383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1eb4f-cfab-4afa-92a1-bc624c83bd85 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:01.484886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:01.560595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15dda9-4e09-44ee-a1bb-78fa5e910ada None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:01.571772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64b06-ec27-43e3-b1e3-63e13de6e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:01.572456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64b06-ec27-43e3-b1e3-63e13de6e116 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:01.572739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64b06-ec27-43e3-b1e3-63e13de6e116 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:01.573016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e64b06-ec27-43e3-b1e3-63e13de6e116 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:01.578317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64b06-ec27-43e3-b1e3-63e13de6e116 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:01.579786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e64b06-ec27-43e3-b1e3-63e13de6e116 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:01.585682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 150/288] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:01 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:01.595366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64b06-ec27-43e3-b1e3-63e13de6e116 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:01.603908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:01.605046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:01.605046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:01.605337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:01.606158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:01.606554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:01.608027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:01.622008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 139/289] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:01.623571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:01.678778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:01.760279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e64b06-ec27-43e3-b1e3-63e13de6e116 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:01.797410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d502c77-51c9-451b-ad0b-b87a1f0813a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:01.798109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d502c77-51c9-451b-ad0b-b87a1f0813a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:01.798387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d502c77-51c9-451b-ad0b-b87a1f0813a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:01.798713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d502c77-51c9-451b-ad0b-b87a1f0813a5 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb/users/da2880cd543648c3bb02bdc967be0c35/roles/a41ebaad7f8e43ef8c749ed1f26c5d64` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:01.805631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d502c77-51c9-451b-ad0b-b87a1f0813a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=28150185d6e141fcb8b89982937b34cb, user_id=da2880cd543648c3bb02bdc967be0c35, role_id=a41ebaad7f8e43ef8c749ed1f26c5d64)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:01.805631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d502c77-51c9-451b-ad0b-b87a1f0813a5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:01.842335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:01.849300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c070d-3263-400f-9e20-56c5cdae90c3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:01.887154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 151/290] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:16:01 2022] PUT /identity/v3/projects/28150185d6e141fcb8b89982937b34cb/users/da2880cd543648c3bb02bdc967be0c35/roles/a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:16:01.899340 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5af9-5c0c-4bca-916c-c64f933f9309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:01.900525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5af9-5c0c-4bca-916c-c64f933f9309 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:01.900809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5af9-5c0c-4bca-916c-c64f933f9309 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:01.901076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5af9-5c0c-4bca-916c-c64f933f9309 None admin] PATH_INFO: `/v3/users/dcf0f1e1c078417aa66e9e6e251c5e2c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:01.904241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5af9-5c0c-4bca-916c-c64f933f9309 None admin] RBAC: Authorizing `identity:get_user(user_id=dcf0f1e1c078417aa66e9e6e251c5e2c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:01.905840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d5af9-5c0c-4bca-916c-c64f933f9309 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:01.911384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 140/291] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:01 2022] GET /identity/v3/users/dcf0f1e1c078417aa66e9e6e251c5e2c => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:01.918014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d502c77-51c9-451b-ad0b-b87a1f0813a5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:02.041730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:02.045858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d502c77-51c9-451b-ad0b-b87a1f0813a5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:02.095505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3569f7-96fe-4fd4-8ee4-ebc70660e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:02.096155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3569f7-96fe-4fd4-8ee4-ebc70660e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:02.096472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3569f7-96fe-4fd4-8ee4-ebc70660e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:02.096775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3569f7-96fe-4fd4-8ee4-ebc70660e3a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:02.188330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3569f7-96fe-4fd4-8ee4-ebc70660e3a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:02.189865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3569f7-96fe-4fd4-8ee4-ebc70660e3a5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:02.294081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:02.297499 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 152/292] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:02.303877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5af9-5c0c-4bca-916c-c64f933f9309 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:02.425601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5af9-5c0c-4bca-916c-c64f933f9309 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:02.465140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d879ff-1655-4f90-9870-0ade20b124d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:02.465804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d879ff-1655-4f90-9870-0ade20b124d8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:02.466087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d879ff-1655-4f90-9870-0ade20b124d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:02.466357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d879ff-1655-4f90-9870-0ade20b124d8 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:02.470283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d879ff-1655-4f90-9870-0ade20b124d8 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:02.471759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d879ff-1655-4f90-9870-0ade20b124d8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:02.473402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 141/293] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:02 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:02.479473 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3569f7-96fe-4fd4-8ee4-ebc70660e3a5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:02.635360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3569f7-96fe-4fd4-8ee4-ebc70660e3a5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:02.681059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb617-aa7e-43bd-b9f9-0a160167169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:02.682579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb617-aa7e-43bd-b9f9-0a160167169e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:02.683063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb617-aa7e-43bd-b9f9-0a160167169e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:02.683556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb617-aa7e-43bd-b9f9-0a160167169e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:02.684508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfb617-aa7e-43bd-b9f9-0a160167169e None admin] RBAC: Adding query filter params (role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=28150185d6e141fcb8b89982937b34cb, user.id=dcf0f1e1c078417aa66e9e6e251c5e2c) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:02.685015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfb617-aa7e-43bd-b9f9-0a160167169e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:02.686684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfb617-aa7e-43bd-b9f9-0a160167169e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:02.698849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 153/294] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:02 2022] GET /identity/v3/role_assignments?user.id=dcf0f1e1c078417aa66e9e6e251c5e2c&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:02.747259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0911-f691-4f1e-a0a0-1e665d407c1e None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:02.747598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0911-f691-4f1e-a0a0-1e665d407c1e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:02.747816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0911-f691-4f1e-a0a0-1e665d407c1e None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:02.749524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 142/295] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:02.755203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548b54-e096-42e4-8a40-f37b89ecaef5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:02.755789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548b54-e096-42e4-8a40-f37b89ecaef5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:02.756291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43548b54-e096-42e4-8a40-f37b89ecaef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:02.782767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-43548b54-e096-42e4-8a40-f37b89ecaef5 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:02.784366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-43548b54-e096-42e4-8a40-f37b89ecaef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:02.869816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:02.882034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 154/296] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:03.163786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0911-f691-4f1e-a0a0-1e665d407c1e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:03.198452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:03.260869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214c784-8e8a-4de2-b794-b3663dcd8e61 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.261216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214c784-8e8a-4de2-b794-b3663dcd8e61 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.261499 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214c784-8e8a-4de2-b794-b3663dcd8e61 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.262907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 155/297] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:03.268100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc91d2-58d4-4c73-97b3-2461ae6fb481 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.268387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc91d2-58d4-4c73-97b3-2461ae6fb481 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.268658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc91d2-58d4-4c73-97b3-2461ae6fb481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.280258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0911-f691-4f1e-a0a0-1e665d407c1e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:03.307950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-52bc91d2-58d4-4c73-97b3-2461ae6fb481 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:03.310041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-52bc91d2-58d4-4c73-97b3-2461ae6fb481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:03.317782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ea1c3-07fa-47f1-ba79-7fcf403a8350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:03.318421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea1c3-07fa-47f1-ba79-7fcf403a8350 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.318701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea1c3-07fa-47f1-ba79-7fcf403a8350 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.318975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea1c3-07fa-47f1-ba79-7fcf403a8350 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.331067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ea1c3-07fa-47f1-ba79-7fcf403a8350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f56ea1c3-07fa-47f1-ba79-7fcf403a8350 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:03.335823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:03.336682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:03.338048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 143/298] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:03.347022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ea1c3-07fa-47f1-ba79-7fcf403a8350 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:03.397981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 156/299] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:03.401221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eee0d-3716-414d-a36e-d35c2742725b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.401999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eee0d-3716-414d-a36e-d35c2742725b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.402545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eee0d-3716-414d-a36e-d35c2742725b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.404807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 157/300] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:03.410107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758914-e115-4922-8e73-d91ef6ac9ef4 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.410609 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758914-e115-4922-8e73-d91ef6ac9ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.411184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04758914-e115-4922-8e73-d91ef6ac9ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.431192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-04758914-e115-4922-8e73-d91ef6ac9ef4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:03.432696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-04758914-e115-4922-8e73-d91ef6ac9ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:03.451778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:03.461588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ea1c3-07fa-47f1-ba79-7fcf403a8350 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:03.497975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:03.498612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.498857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.499129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.499792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:03.500094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:03.501520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:03.516424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 144/301] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:03.516424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:03.517033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 158/302] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:03.618063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2dbf8-2f96-4332-a333-2372eaf66d39 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:03.652888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4178-24e2-48c2-87ea-7672410e5141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:03.653509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4178-24e2-48c2-87ea-7672410e5141 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.653818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4178-24e2-48c2-87ea-7672410e5141 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.654091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a4178-24e2-48c2-87ea-7672410e5141 None admin] PATH_INFO: `/v3/users/2af1b6a8cfd3410cb93a78dfd81ee7e3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.655224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4178-24e2-48c2-87ea-7672410e5141 None admin] RBAC: Authorizing `identity:get_user(user_id=2af1b6a8cfd3410cb93a78dfd81ee7e3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:03.656720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a4178-24e2-48c2-87ea-7672410e5141 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:03.662972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 145/303] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:03 2022] GET /identity/v3/users/2af1b6a8cfd3410cb93a78dfd81ee7e3 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:03.666725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04758914-e115-4922-8e73-d91ef6ac9ef4 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:03.668225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4178-24e2-48c2-87ea-7672410e5141 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:03.690557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:03.735448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:03.775763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a4178-24e2-48c2-87ea-7672410e5141 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:03.799467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04758914-e115-4922-8e73-d91ef6ac9ef4 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:03.811915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0856-be43-4743-b6e4-0df525e1fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:03.812552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0856-be43-4743-b6e4-0df525e1fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.812830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0856-be43-4743-b6e4-0df525e1fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.813102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d0856-be43-4743-b6e4-0df525e1fcf1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.824326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d0856-be43-4743-b6e4-0df525e1fcf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-376d0856-be43-4743-b6e4-0df525e1fcf1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:03.829096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:03.829991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:03.830870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 146/304] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:03.831514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0856-be43-4743-b6e4-0df525e1fcf1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:03.845051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d130e-0bf1-4841-b4f9-7a4dc7380bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:03.845872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d130e-0bf1-4841-b4f9-7a4dc7380bad None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.846153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d130e-0bf1-4841-b4f9-7a4dc7380bad None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.846471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d130e-0bf1-4841-b4f9-7a4dc7380bad None admin] PATH_INFO: `/v3/system/users/2af1b6a8cfd3410cb93a78dfd81ee7e3/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.847869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d130e-0bf1-4841-b4f9-7a4dc7380bad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2af1b6a8cfd3410cb93a78dfd81ee7e3, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:03.849265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d130e-0bf1-4841-b4f9-7a4dc7380bad None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:03.914270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:03.916016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 159/305] 10.222.0.61 () {58 vars in 1334 bytes} [Tue Aug 23 16:16:03 2022] PUT /identity/v3/system/users/2af1b6a8cfd3410cb93a78dfd81ee7e3/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:03.916889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d130e-0bf1-4841-b4f9-7a4dc7380bad None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:03.940644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d0856-be43-4743-b6e4-0df525e1fcf1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:03.977853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a53f9-85ea-4a7b-8cfc-6aa2e3b57013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:03.978578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a53f9-85ea-4a7b-8cfc-6aa2e3b57013 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:03.978849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a53f9-85ea-4a7b-8cfc-6aa2e3b57013 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:03.979119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a53f9-85ea-4a7b-8cfc-6aa2e3b57013 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:03.980389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a53f9-85ea-4a7b-8cfc-6aa2e3b57013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:03.981994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a53f9-85ea-4a7b-8cfc-6aa2e3b57013 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:03.983652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 147/306] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:03.995900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a53f9-85ea-4a7b-8cfc-6aa2e3b57013 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:04.091550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d130e-0bf1-4841-b4f9-7a4dc7380bad None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:04.109497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:04.136779 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:04.137451 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:04.137790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:04.138294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:04.139432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:04.139742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:04.141740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:04.148146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a53f9-85ea-4a7b-8cfc-6aa2e3b57013 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:04.153594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 160/307] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:04.160447 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:04.187647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a53f01-b81a-46e3-9b08-66362187dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:04.188180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53f01-b81a-46e3-9b08-66362187dbd6 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:04.188527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53f01-b81a-46e3-9b08-66362187dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:04.188722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a53f01-b81a-46e3-9b08-66362187dbd6 None admin] PATH_INFO: `/v3/groups` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:04.189351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53f01-b81a-46e3-9b08-66362187dbd6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:04.190952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a53f01-b81a-46e3-9b08-66362187dbd6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:04.264745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 148/308] 10.222.0.61 () {60 vars in 1134 bytes} [Tue Aug 23 16:16:03 2022] POST /identity/v3/groups => generated 229 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:16:04.281673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dbf25-4006-45da-b83d-fdba075880c7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:04.299543 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7a2f-ac0a-41fc-b74d-d3a9c319fb4c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:04.299849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7a2f-ac0a-41fc-b74d-d3a9c319fb4c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:04.300098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7a2f-ac0a-41fc-b74d-d3a9c319fb4c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:04.301769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 149/309] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:04.307973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f491599-e86f-438d-87f1-daaadef61151 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:04.308260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f491599-e86f-438d-87f1-daaadef61151 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:04.308518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f491599-e86f-438d-87f1-daaadef61151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:04.320202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4652-2439-40a9-9c7e-853771280e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:04.320854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4652-2439-40a9-9c7e-853771280e30 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:04.321137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4652-2439-40a9-9c7e-853771280e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:04.321414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4652-2439-40a9-9c7e-853771280e30 None admin] PATH_INFO: `/v3/users/f0eba90222814bfaaa290caee84def13` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:04.328041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2f491599-e86f-438d-87f1-daaadef61151 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:04.329259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2f491599-e86f-438d-87f1-daaadef61151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:04.331686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:04.336943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b4652-2439-40a9-9c7e-853771280e30 None admin] RBAC: Authorizing `identity:get_user(user_id=f0eba90222814bfaaa290caee84def13)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:04.338502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b4652-2439-40a9-9c7e-853771280e30 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:04.340316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 161/310] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:04 2022] GET /identity/v3/users/f0eba90222814bfaaa290caee84def13 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:04.346567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4652-2439-40a9-9c7e-853771280e30 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:04.391447 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:04.416941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 150/311] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:04.467681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4652-2439-40a9-9c7e-853771280e30 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:04.504800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:04.505404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:04.505702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:04.505977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:04.506705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] RBAC: Adding query filter params (role.id=a41ebaad7f8e43ef8c749ed1f26c5d64, user.id=f0eba90222814bfaaa290caee84def13, scope.system=all) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:04.507066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:04.508517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:04.514382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 162/312] 10.222.0.61 () {56 vars in 1308 bytes} [Tue Aug 23 16:16:04 2022] GET /identity/v3/role_assignments?user.id=f0eba90222814bfaaa290caee84def13&scope.system=all&role.id=a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:04.689142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f491599-e86f-438d-87f1-daaadef61151 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:04.794293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f491599-e86f-438d-87f1-daaadef61151 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:04.830130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c817-a53b-4425-87f4-2d5e8f6d80e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:04.831009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c817-a53b-4425-87f4-2d5e8f6d80e1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:04.831451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c817-a53b-4425-87f4-2d5e8f6d80e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:04.831876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960c817-a53b-4425-87f4-2d5e8f6d80e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:04.839781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:04.843311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960c817-a53b-4425-87f4-2d5e8f6d80e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c960c817-a53b-4425-87f4-2d5e8f6d80e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:04.848054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:04.850468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:04.851532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 151/313] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:04.856749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:04.966349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:04.969290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3e81-2a6f-4461-b47b-c7b8036ec7dc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:05.005602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:05.006236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:05.006516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:05.006784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:05.007456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:05.007754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:05.009142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:05.018552 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 163/314] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:05.031291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c817-a53b-4425-87f4-2d5e8f6d80e1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:05.146760 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960c817-a53b-4425-87f4-2d5e8f6d80e1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:05.180856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c2627-f225-4a6d-9b91-54a9cb8cedfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:05.182059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c2627-f225-4a6d-9b91-54a9cb8cedfc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:05.182334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c2627-f225-4a6d-9b91-54a9cb8cedfc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:05.182604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c2627-f225-4a6d-9b91-54a9cb8cedfc None admin] PATH_INFO: `/v3/users/da2880cd543648c3bb02bdc967be0c35` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:05.183728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c2627-f225-4a6d-9b91-54a9cb8cedfc None admin] RBAC: Authorizing `identity:get_user(user_id=da2880cd543648c3bb02bdc967be0c35)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:05.185157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c2627-f225-4a6d-9b91-54a9cb8cedfc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:05.187047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 152/315] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:05 2022] GET /identity/v3/users/da2880cd543648c3bb02bdc967be0c35 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:05.194694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:05.296388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941dc1-eb65-46e6-a5b1-2374d9b1a47a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:05.330066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109c22d-f867-460f-8374-880a4d931ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:05.330673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109c22d-f867-460f-8374-880a4d931ede None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:05.330951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109c22d-f867-460f-8374-880a4d931ede None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:05.331221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109c22d-f867-460f-8374-880a4d931ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:05.362317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:05.401034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109c22d-f867-460f-8374-880a4d931ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:05.402534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109c22d-f867-460f-8374-880a4d931ede None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:05.509951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 164/316] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:05.515862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c2627-f225-4a6d-9b91-54a9cb8cedfc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:05.591797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:05.627228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c2627-f225-4a6d-9b91-54a9cb8cedfc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:05.666410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f48b-dce0-4520-a668-5435587a023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:05.667369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f48b-dce0-4520-a668-5435587a023a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:05.667892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f48b-dce0-4520-a668-5435587a023a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:05.668379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f48b-dce0-4520-a668-5435587a023a None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:05.669730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65f48b-dce0-4520-a668-5435587a023a None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:05.671389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65f48b-dce0-4520-a668-5435587a023a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:05.673279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 153/317] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:05 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:05.679538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109c22d-f867-460f-8374-880a4d931ede None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:05.746924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:05.782899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109c22d-f867-460f-8374-880a4d931ede None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:05.824499 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f1bfd-6434-4d65-af7a-7c8c8d56f026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:05.825112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1bfd-6434-4d65-af7a-7c8c8d56f026 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:05.825392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1bfd-6434-4d65-af7a-7c8c8d56f026 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:05.825694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1bfd-6434-4d65-af7a-7c8c8d56f026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:05.826432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1bfd-6434-4d65-af7a-7c8c8d56f026 None admin] RBAC: Adding query filter params (role.id=a41ebaad7f8e43ef8c749ed1f26c5d64, scope.project.id=28150185d6e141fcb8b89982937b34cb, user.id=da2880cd543648c3bb02bdc967be0c35) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:05.826741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1bfd-6434-4d65-af7a-7c8c8d56f026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:05.828179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1bfd-6434-4d65-af7a-7c8c8d56f026 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:05.834622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 165/318] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:05 2022] GET /identity/v3/role_assignments?user.id=da2880cd543648c3bb02bdc967be0c35&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:05.932922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ce76-0390-47c3-b93c-f9fdd8f3bcec None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:05.933425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ce76-0390-47c3-b93c-f9fdd8f3bcec None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:05.933425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8ce76-0390-47c3-b93c-f9fdd8f3bcec None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:05.936771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 154/319] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:05.942460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ab317-6a8a-45ec-9207-53067c19c1b0 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:05.942962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ab317-6a8a-45ec-9207-53067c19c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:05.943036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ab317-6a8a-45ec-9207-53067c19c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:05.961862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7f0ab317-6a8a-45ec-9207-53067c19c1b0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:05.963105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7f0ab317-6a8a-45ec-9207-53067c19c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:06.036649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 166/320] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:06.304929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8ce76-0390-47c3-b93c-f9fdd8f3bcec None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:06.397140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10aa3-c946-4eb2-8cb8-e8918a8157fb None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.397710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10aa3-c946-4eb2-8cb8-e8918a8157fb None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.397983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10aa3-c946-4eb2-8cb8-e8918a8157fb None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.399618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 167/321] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:06.404617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad104ea-2691-4bf5-8b7b-8b00edad36b7 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.404902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad104ea-2691-4bf5-8b7b-8b00edad36b7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.405168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad104ea-2691-4bf5-8b7b-8b00edad36b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.410321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8ce76-0390-47c3-b93c-f9fdd8f3bcec None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:06.423054 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8ad104ea-2691-4bf5-8b7b-8b00edad36b7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:06.424225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8ad104ea-2691-4bf5-8b7b-8b00edad36b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:06.448403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d927e8-c296-4da0-a00b-2df566d5a117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:06.449037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d927e8-c296-4da0-a00b-2df566d5a117 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.449316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d927e8-c296-4da0-a00b-2df566d5a117 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.449589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d927e8-c296-4da0-a00b-2df566d5a117 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.451441 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:06.460580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d927e8-c296-4da0-a00b-2df566d5a117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-52d927e8-c296-4da0-a00b-2df566d5a117 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:06.465248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:06.477456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 155/322] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:06.478381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839d2b-7781-4951-9070-273f4026f8aa None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.479114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839d2b-7781-4951-9070-273f4026f8aa None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.479114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f839d2b-7781-4951-9070-273f4026f8aa None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.479114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 156/323] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:06.479114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f839d2b-7781-4951-9070-273f4026f8aa None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:06.479351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:06.493300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 168/324] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:06.495046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ec9d-677f-42be-b3c0-ec6690313942 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.495328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ec9d-677f-42be-b3c0-ec6690313942 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.495650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ec9d-677f-42be-b3c0-ec6690313942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.513758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-fdf9ec9d-677f-42be-b3c0-ec6690313942 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:06.514938 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fdf9ec9d-677f-42be-b3c0-ec6690313942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:06.579885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f839d2b-7781-4951-9070-273f4026f8aa None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:06.591041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 169/325] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:06.614721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:06.615322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.615600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.615868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.616520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:06.616816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:06.618210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:06.626893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 157/326] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:06.632437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ec9d-677f-42be-b3c0-ec6690313942 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:06.734966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ec9d-677f-42be-b3c0-ec6690313942 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:06.754265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:06.764578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:06.772761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b161-3243-4432-896e-cc5ae895f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:06.774089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b161-3243-4432-896e-cc5ae895f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.774580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b161-3243-4432-896e-cc5ae895f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.775065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1b161-3243-4432-896e-cc5ae895f4f1 None admin] PATH_INFO: `/v3/users/2af1b6a8cfd3410cb93a78dfd81ee7e3` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.776861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1b161-3243-4432-896e-cc5ae895f4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=2af1b6a8cfd3410cb93a78dfd81ee7e3)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:06.779052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1b161-3243-4432-896e-cc5ae895f4f1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:06.781501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 170/327] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:06 2022] GET /identity/v3/users/2af1b6a8cfd3410cb93a78dfd81ee7e3 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:06.787600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b161-3243-4432-896e-cc5ae895f4f1 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:06.822266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:06.866382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4cfd3-dda3-466e-a84d-8491a5005571 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:06.903303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ecc90-27ea-44b0-ae15-61aa9901b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:06.903520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1b161-3243-4432-896e-cc5ae895f4f1 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:06.903934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ecc90-27ea-44b0-ae15-61aa9901b91e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.904216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ecc90-27ea-44b0-ae15-61aa9901b91e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.904490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ecc90-27ea-44b0-ae15-61aa9901b91e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.905602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ecc90-27ea-44b0-ae15-61aa9901b91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:06.907097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ecc90-27ea-44b0-ae15-61aa9901b91e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:06.908673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 158/328] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:06.909438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ecc90-27ea-44b0-ae15-61aa9901b91e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:06.936744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:06.937346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:06.937647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:06.937913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:06.938638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] RBAC: Adding query filter params (role.id=c2202fa3e5ce4430b5c100bfd6c74f21, user.id=2af1b6a8cfd3410cb93a78dfd81ee7e3, scope.system=all) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:06.938949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:06.940375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:06.952716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 171/329] 10.222.0.61 () {56 vars in 1308 bytes} [Tue Aug 23 16:16:06 2022] GET /identity/v3/role_assignments?user.id=2af1b6a8cfd3410cb93a78dfd81ee7e3&scope.system=all&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:06.953601 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:07.001221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:07.021597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ecc90-27ea-44b0-ae15-61aa9901b91e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:07.062244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:07.074252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399e246-2025-49d8-b10a-e66052289217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:07.074889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399e246-2025-49d8-b10a-e66052289217 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:07.075184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399e246-2025-49d8-b10a-e66052289217 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:07.075478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399e246-2025-49d8-b10a-e66052289217 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:07.077947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcbf38-583a-4db7-89f4-3590cd43c968 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:07.087552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399e246-2025-49d8-b10a-e66052289217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9399e246-2025-49d8-b10a-e66052289217 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:07.092846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:07.093801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:07.094585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:07.098318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 159/330] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:07.103504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399e246-2025-49d8-b10a-e66052289217 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:07.125210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50aa68-88b8-4cfa-8514-1032d9184142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:07.125807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aa68-88b8-4cfa-8514-1032d9184142 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:07.126088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aa68-88b8-4cfa-8514-1032d9184142 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:07.126358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50aa68-88b8-4cfa-8514-1032d9184142 None admin] PATH_INFO: `/v3/groups` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:07.126994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50aa68-88b8-4cfa-8514-1032d9184142 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:07.128479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50aa68-88b8-4cfa-8514-1032d9184142 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:07.208657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399e246-2025-49d8-b10a-e66052289217 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:07.217956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 172/331] 10.222.0.61 () {60 vars in 1134 bytes} [Tue Aug 23 16:16:06 2022] POST /identity/v3/groups => generated 226 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:07.244653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:07.245323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:07.245599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:07.245893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:07.246572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:07.246870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:07.248325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:07.257378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 160/332] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:07.263923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50aa68-88b8-4cfa-8514-1032d9184142 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:07.371027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50aa68-88b8-4cfa-8514-1032d9184142 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:07.372637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:07.407494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c59fe7-fd64-4765-bd4f-b00a04a4aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:07.408145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59fe7-fd64-4765-bd4f-b00a04a4aac6 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:07.408425 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59fe7-fd64-4765-bd4f-b00a04a4aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:07.408693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59fe7-fd64-4765-bd4f-b00a04a4aac6 None admin] PATH_INFO: `/v3/users/f0eba90222814bfaaa290caee84def13` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:07.409886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c59fe7-fd64-4765-bd4f-b00a04a4aac6 None admin] RBAC: Authorizing `identity:get_user(user_id=f0eba90222814bfaaa290caee84def13)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:07.411369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c59fe7-fd64-4765-bd4f-b00a04a4aac6 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:07.412991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 173/333] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:07 2022] GET /identity/v3/users/f0eba90222814bfaaa290caee84def13 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:07.419502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:07.470018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:07.532853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebcc89-a786-41fa-b70a-c3942ece91b0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:07.568558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cbf97-73ef-4785-88f4-510d769dad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:07.569222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cbf97-73ef-4785-88f4-510d769dad8f None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:07.569495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cbf97-73ef-4785-88f4-510d769dad8f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:07.569796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cbf97-73ef-4785-88f4-510d769dad8f None admin] PATH_INFO: `/v3/system/users/f0eba90222814bfaaa290caee84def13/roles/a41ebaad7f8e43ef8c749ed1f26c5d64` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:07.571208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cbf97-73ef-4785-88f4-510d769dad8f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f0eba90222814bfaaa290caee84def13, role_id=a41ebaad7f8e43ef8c749ed1f26c5d64)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:07.573206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cbf97-73ef-4785-88f4-510d769dad8f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:07.641335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 161/334] 10.222.0.61 () {58 vars in 1334 bytes} [Tue Aug 23 16:16:07 2022] PUT /identity/v3/system/users/f0eba90222814bfaaa290caee84def13/roles/a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:09.392910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11062a9-a1bf-43a4-a337-22d1bb7329ab None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:09.393502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11062a9-a1bf-43a4-a337-22d1bb7329ab None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:09.393502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11062a9-a1bf-43a4-a337-22d1bb7329ab None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:09.395172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 174/335] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:09.400594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799422a2-6d43-4498-94c4-e121110de9ba None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:09.401505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799422a2-6d43-4498-94c4-e121110de9ba None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:09.402031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799422a2-6d43-4498-94c4-e121110de9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:09.430990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-799422a2-6d43-4498-94c4-e121110de9ba None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:09.433107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-799422a2-6d43-4498-94c4-e121110de9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:09.539957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 162/336] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:09.964637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8836464-3f35-4bc1-8889-4def35b51358 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:09.965070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8836464-3f35-4bc1-8889-4def35b51358 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:09.965184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8836464-3f35-4bc1-8889-4def35b51358 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:09.966641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 175/337] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:09.975923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beeda1-92dd-4ac5-a867-2e6b3da94d06 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:09.976602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beeda1-92dd-4ac5-a867-2e6b3da94d06 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:09.977094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beeda1-92dd-4ac5-a867-2e6b3da94d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.001824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-21beeda1-92dd-4ac5-a867-2e6b3da94d06 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:10.003334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-21beeda1-92dd-4ac5-a867-2e6b3da94d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:10.028170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46551d9-0a20-4380-a5db-b02521175476 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.028489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46551d9-0a20-4380-a5db-b02521175476 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.028716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46551d9-0a20-4380-a5db-b02521175476 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.030195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 176/338] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:10.036368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b6adb-3e56-4fe1-82a4-e9bcb6ab7e7e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.036645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b6adb-3e56-4fe1-82a4-e9bcb6ab7e7e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.036943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b6adb-3e56-4fe1-82a4-e9bcb6ab7e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.062682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e20b6adb-3e56-4fe1-82a4-e9bcb6ab7e7e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:10.063895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e20b6adb-3e56-4fe1-82a4-e9bcb6ab7e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:10.144658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:10.175235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 177/339] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:10.176564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d584-fb51-4a2f-ade6-c9497b75f6fc None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.176852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d584-fb51-4a2f-ade6-c9497b75f6fc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.177130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83d584-fb51-4a2f-ade6-c9497b75f6fc None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.178456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 178/340] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:10.179152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d584-fb51-4a2f-ade6-c9497b75f6fc None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:10.200139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 163/341] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:10.201424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448ccf-2a37-42e3-97ad-29b608bd5ccd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.201783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448ccf-2a37-42e3-97ad-29b608bd5ccd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.202080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448ccf-2a37-42e3-97ad-29b608bd5ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.246106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-77448ccf-2a37-42e3-97ad-29b608bd5ccd None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:10.247283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-77448ccf-2a37-42e3-97ad-29b608bd5ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:10.319264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:10.323746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83d584-fb51-4a2f-ade6-c9497b75f6fc None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:10.365128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658c0e-6fd4-4f2e-af0b-812e6e5635e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:10.365931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658c0e-6fd4-4f2e-af0b-812e6e5635e8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.366298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658c0e-6fd4-4f2e-af0b-812e6e5635e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.366645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd658c0e-6fd4-4f2e-af0b-812e6e5635e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.367259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 164/342] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:10.387012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd658c0e-6fd4-4f2e-af0b-812e6e5635e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-cd658c0e-6fd4-4f2e-af0b-812e6e5635e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:10.392069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:10.392976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:10.394253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 179/343] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:10.399214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77448ccf-2a37-42e3-97ad-29b608bd5ccd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:10.513850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:10.518539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77448ccf-2a37-42e3-97ad-29b608bd5ccd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:10.561070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:10.561711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.561993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.562263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.562934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:10.563235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:10.564603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:10.577731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 165/344] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:10.580017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658c0e-6fd4-4f2e-af0b-812e6e5635e8 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:10.591797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:10.709426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd658c0e-6fd4-4f2e-af0b-812e6e5635e8 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:10.724947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdd7dd-b838-4f76-8236-fce68fea3989 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:10.747462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac5581-ea47-4037-96f3-32d4de51a9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:10.748075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac5581-ea47-4037-96f3-32d4de51a9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.748358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac5581-ea47-4037-96f3-32d4de51a9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.748634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac5581-ea47-4037-96f3-32d4de51a9f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.780478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:10.781327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280bbc6-7596-4e2e-b99d-f0011d69bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:10.782009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280bbc6-7596-4e2e-b99d-f0011d69bb22 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.782287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280bbc6-7596-4e2e-b99d-f0011d69bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.782556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280bbc6-7596-4e2e-b99d-f0011d69bb22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:10.798778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280bbc6-7596-4e2e-b99d-f0011d69bb22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9280bbc6-7596-4e2e-b99d-f0011d69bb22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:10.804021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:10.804896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:16:10.806686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:10.810066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 166/345] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:10.810933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280bbc6-7596-4e2e-b99d-f0011d69bb22 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:10.825595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac5581-ea47-4037-96f3-32d4de51a9f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:10.827124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac5581-ea47-4037-96f3-32d4de51a9f3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:10.878002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:10.951502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280bbc6-7596-4e2e-b99d-f0011d69bb22 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:10.959827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 180/346] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:10.960710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac5581-ea47-4037-96f3-32d4de51a9f3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:10.998453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1768-0a5c-435e-8b50-b1c4804906ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:10.999052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1768-0a5c-435e-8b50-b1c4804906ec None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:10.999412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1768-0a5c-435e-8b50-b1c4804906ec None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:10.999595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1768-0a5c-435e-8b50-b1c4804906ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.015050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1768-0a5c-435e-8b50-b1c4804906ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-417f1768-0a5c-435e-8b50-b1c4804906ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:11.021867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:11.022880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:11.023758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 167/347] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:11.025460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1768-0a5c-435e-8b50-b1c4804906ec None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:11.046172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.104678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac5581-ea47-4037-96f3-32d4de51a9f3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.128076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.142294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12155a3d-470f-44a1-bd35-fef1744cad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.142921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12155a3d-470f-44a1-bd35-fef1744cad73 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.143203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12155a3d-470f-44a1-bd35-fef1744cad73 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.143474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12155a3d-470f-44a1-bd35-fef1744cad73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.147413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1768-0a5c-435e-8b50-b1c4804906ec None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.156613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12155a3d-470f-44a1-bd35-fef1744cad73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-12155a3d-470f-44a1-bd35-fef1744cad73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:11.161871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:11.162807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:11.163655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 181/348] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:16:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:11.164806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa872b-4742-471a-baed-80428245f4d6 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.164806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa872b-4742-471a-baed-80428245f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.165062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa872b-4742-471a-baed-80428245f4d6 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.166651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 182/349] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:11.167441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa872b-4742-471a-baed-80428245f4d6 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:11.186363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.188149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.188434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.189121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.190847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:11.190847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:11.191607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:11.202939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 168/350] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:11.203796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:11.297689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa872b-4742-471a-baed-80428245f4d6 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.324143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.328399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b8326-9cde-4018-a33e-114efa7b0b19 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.345686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c0ec7-49c7-480a-92f0-cdaf367dda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.346651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0ec7-49c7-480a-92f0-cdaf367dda7b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.346932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0ec7-49c7-480a-92f0-cdaf367dda7b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.347204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0ec7-49c7-480a-92f0-cdaf367dda7b None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.349673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c0ec7-49c7-480a-92f0-cdaf367dda7b None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:11.352802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c0ec7-49c7-480a-92f0-cdaf367dda7b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:11.355155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 183/351] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:11 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:11.358955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78f31-bacd-4c4c-9844-6e82f37e77e6 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.359231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78f31-bacd-4c4c-9844-6e82f37e77e6 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.359503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78f31-bacd-4c4c-9844-6e82f37e77e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.381893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-a4b78f31-bacd-4c4c-9844-6e82f37e77e6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:11.383093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a4b78f31-bacd-4c4c-9844-6e82f37e77e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:11.387031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.387031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.387031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.387031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.387350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:11.387350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:11.388358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:11.398091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 169/352] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:11.398727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:11.414348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.483164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 184/353] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:11.483861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78f31-bacd-4c4c-9844-6e82f37e77e6 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:11.524410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe48e06-4196-4c73-99ff-abd95f950d31 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.568886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.569921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.570427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.570899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.571923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:11.572456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:11.574110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:11.585861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 170/354] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:11.587024 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:11.635273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78f31-bacd-4c4c-9844-6e82f37e77e6 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.659085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.668915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.682059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb8bd2-bcf2-43ce-8df7-54ab5d1876e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.682720 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb8bd2-bcf2-43ce-8df7-54ab5d1876e9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.683082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb8bd2-bcf2-43ce-8df7-54ab5d1876e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.683367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb8bd2-bcf2-43ce-8df7-54ab5d1876e9 None admin] PATH_INFO: `/v3/users/f0eba90222814bfaaa290caee84def13` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.684997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb8bd2-bcf2-43ce-8df7-54ab5d1876e9 None admin] RBAC: Authorizing `identity:get_user(user_id=f0eba90222814bfaaa290caee84def13)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:11.686783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb8bd2-bcf2-43ce-8df7-54ab5d1876e9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:11.689041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 185/355] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:16:11 2022] GET /identity/v3/users/f0eba90222814bfaaa290caee84def13 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:11.690099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb8bd2-bcf2-43ce-8df7-54ab5d1876e9 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:11.719191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83050b7b-bd87-47b4-ba25-892e8e8b0605 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.768326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef72f59-8ec4-4a43-b8ab-62a2699e7fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.769729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72f59-8ec4-4a43-b8ab-62a2699e7fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.770228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72f59-8ec4-4a43-b8ab-62a2699e7fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.770717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72f59-8ec4-4a43-b8ab-62a2699e7fa7 None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.780182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef72f59-8ec4-4a43-b8ab-62a2699e7fa7 None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:11.781895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef72f59-8ec4-4a43-b8ab-62a2699e7fa7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:11.784659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 171/356] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:11 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:11.785989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef72f59-8ec4-4a43-b8ab-62a2699e7fa7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:11.823071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb8bd2-bcf2-43ce-8df7-54ab5d1876e9 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.859969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41eea34-6f4a-4f63-929d-598728a73918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.860593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41eea34-6f4a-4f63-929d-598728a73918 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.860874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41eea34-6f4a-4f63-929d-598728a73918 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.861416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41eea34-6f4a-4f63-929d-598728a73918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:11.925091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef72f59-8ec4-4a43-b8ab-62a2699e7fa7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:11.930351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.945163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41eea34-6f4a-4f63-929d-598728a73918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:11.946694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41eea34-6f4a-4f63-929d-598728a73918 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:11.955716 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:11.961156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03645-ee16-453b-81d6-9da32e17d750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:11.962060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03645-ee16-453b-81d6-9da32e17d750 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:11.962538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03645-ee16-453b-81d6-9da32e17d750 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:11.962814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb03645-ee16-453b-81d6-9da32e17d750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.044452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03645-ee16-453b-81d6-9da32e17d750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:12.044968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb03645-ee16-453b-81d6-9da32e17d750 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:12.071283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 186/357] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:12.075229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41eea34-6f4a-4f63-929d-598728a73918 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:12.174484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 172/358] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:12.174484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03645-ee16-453b-81d6-9da32e17d750 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:12.184705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:12.198387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41eea34-6f4a-4f63-929d-598728a73918 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:12.205659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:12.244767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:12.245384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.245686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.245962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.246694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] RBAC: Adding query filter params (role.id=a41ebaad7f8e43ef8c749ed1f26c5d64, user.id=f0eba90222814bfaaa290caee84def13, scope.system=all) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:12.247003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:12.248450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:12.264137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 187/359] 10.222.0.61 () {56 vars in 1308 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/role_assignments?user.id=f0eba90222814bfaaa290caee84def13&scope.system=all&role.id=a41ebaad7f8e43ef8c749ed1f26c5d64 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:12.264982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:12.291843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb03645-ee16-453b-81d6-9da32e17d750 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:12.347162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fde582-0fea-46bc-928c-a8cf7ec5e597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:12.350415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fde582-0fea-46bc-928c-a8cf7ec5e597 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.350415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fde582-0fea-46bc-928c-a8cf7ec5e597 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.350415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fde582-0fea-46bc-928c-a8cf7ec5e597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.350415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fde582-0fea-46bc-928c-a8cf7ec5e597 None admin] RBAC: Adding query filter params (group.id=e86ffdc28199461bb17756c1ff4abec0, role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=e13bb57123f8483b9d6f24c63738d6be) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:12.350415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fde582-0fea-46bc-928c-a8cf7ec5e597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:12.351770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fde582-0fea-46bc-928c-a8cf7ec5e597 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:12.360744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 173/360] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/role_assignments?group.id=e86ffdc28199461bb17756c1ff4abec0&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:12.367762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501d8e-1e12-4992-97f2-d02475907a2a None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.367762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501d8e-1e12-4992-97f2-d02475907a2a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.367762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56501d8e-1e12-4992-97f2-d02475907a2a None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.368104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 174/361] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:12.370053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56501d8e-1e12-4992-97f2-d02475907a2a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:12.406085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46299388-8bd7-404b-b9f4-07a094d70ecb None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:12.455188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc687c1-6a75-4f1d-9860-07b1d4a4e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:12.455989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc687c1-6a75-4f1d-9860-07b1d4a4e59f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.456276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc687c1-6a75-4f1d-9860-07b1d4a4e59f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.456826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc687c1-6a75-4f1d-9860-07b1d4a4e59f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.470186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc687c1-6a75-4f1d-9860-07b1d4a4e59f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-ecc687c1-6a75-4f1d-9860-07b1d4a4e59f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:12.476608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:12.477584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:12.479041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 188/362] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:12.479715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc687c1-6a75-4f1d-9860-07b1d4a4e59f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:12.484556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:12.508217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:12.523959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56501d8e-1e12-4992-97f2-d02475907a2a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:12.574106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa747c87-46c6-443b-84f0-0d93a6c2ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:12.574834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa747c87-46c6-443b-84f0-0d93a6c2ef7b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.575114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa747c87-46c6-443b-84f0-0d93a6c2ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.575382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa747c87-46c6-443b-84f0-0d93a6c2ef7b None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.576604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa747c87-46c6-443b-84f0-0d93a6c2ef7b None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:12.578260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa747c87-46c6-443b-84f0-0d93a6c2ef7b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:12.580228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 175/363] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:12.581243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a3d55-3861-4858-b3ca-96d8b2dcb1f5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.581527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a3d55-3861-4858-b3ca-96d8b2dcb1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.585950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a3d55-3861-4858-b3ca-96d8b2dcb1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.605578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-028a3d55-3861-4858-b3ca-96d8b2dcb1f5 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:12.606815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-028a3d55-3861-4858-b3ca-96d8b2dcb1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:12.641973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc687c1-6a75-4f1d-9860-07b1d4a4e59f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:12.694623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce896f-155c-41ac-830a-2510026ed44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:12.695687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce896f-155c-41ac-830a-2510026ed44a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.695972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce896f-155c-41ac-830a-2510026ed44a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.696611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce896f-155c-41ac-830a-2510026ed44a None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.697976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce896f-155c-41ac-830a-2510026ed44a None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:12.699436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce896f-155c-41ac-830a-2510026ed44a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:12.701229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 189/364] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:12.704951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce896f-155c-41ac-830a-2510026ed44a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:12.705071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 176/365] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:12.708134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a3d55-3861-4858-b3ca-96d8b2dcb1f5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:12.782458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:12.815126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce896f-155c-41ac-830a-2510026ed44a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:12.823161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:12.831241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a3d55-3861-4858-b3ca-96d8b2dcb1f5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:12.859641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:12.860483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.861903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.862357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.863182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:12.863645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:12.865059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:12.876538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723af5-afd9-44df-b704-10e9a7d70643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:12.877293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723af5-afd9-44df-b704-10e9a7d70643 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:12.877681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723af5-afd9-44df-b704-10e9a7d70643 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:12.878013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723af5-afd9-44df-b704-10e9a7d70643 None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:12.879183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19723af5-afd9-44df-b704-10e9a7d70643 None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:12.880721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19723af5-afd9-44df-b704-10e9a7d70643 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:12.882489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 177/366] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:12.882935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 190/367] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:12.883789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723af5-afd9-44df-b704-10e9a7d70643 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:12.889853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.011075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723af5-afd9-44df-b704-10e9a7d70643 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.022341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041e26a-1f4e-4905-a2ec-61de971609f4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.059498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62810-bbd8-4bda-908b-aa65fd9a63c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.060159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62810-bbd8-4bda-908b-aa65fd9a63c6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.062463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62810-bbd8-4bda-908b-aa65fd9a63c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.062463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62810-bbd8-4bda-908b-aa65fd9a63c6 None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.062903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a62810-bbd8-4bda-908b-aa65fd9a63c6 None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:13.064403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a62810-bbd8-4bda-908b-aa65fd9a63c6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:13.066298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 178/368] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:13.067070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62810-bbd8-4bda-908b-aa65fd9a63c6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.074760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4761e-623f-444f-8b28-0279b70be914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.075696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4761e-623f-444f-8b28-0279b70be914 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.076182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4761e-623f-444f-8b28-0279b70be914 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.076747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4761e-623f-444f-8b28-0279b70be914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.079993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:13.108434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:13.169415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4761e-623f-444f-8b28-0279b70be914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:13.170543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4761e-623f-444f-8b28-0279b70be914 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:13.198980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62810-bbd8-4bda-908b-aa65fd9a63c6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.247921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.248895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.249393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.249905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.250751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] RBAC: Adding query filter params (group.id=e86ffdc28199461bb17756c1ff4abec0, role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=28150185d6e141fcb8b89982937b34cb) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:13.251058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:13.252986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:13.260787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 179/369] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:13 2022] GET /identity/v3/role_assignments?group.id=e86ffdc28199461bb17756c1ff4abec0&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:13.261906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.302959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 191/370] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:16:13.303691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4761e-623f-444f-8b28-0279b70be914 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.343960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:13.373152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:13.380867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f675a-7847-43c6-8440-a1853ed118c1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.418883 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fb0ed-849b-49a6-a06e-4f644c321267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.419757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb0ed-849b-49a6-a06e-4f644c321267 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.419982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb0ed-849b-49a6-a06e-4f644c321267 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.420259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb0ed-849b-49a6-a06e-4f644c321267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.427108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4761e-623f-444f-8b28-0279b70be914 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.433280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fb0ed-849b-49a6-a06e-4f644c321267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-4f6fb0ed-849b-49a6-a06e-4f644c321267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:13.438171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:13.439117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:13.439950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 180/371] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:13.440630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fb0ed-849b-49a6-a06e-4f644c321267 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.478547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.479414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.479866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.480286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.481368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] RBAC: Adding query filter params (group.id=e86ffdc28199461bb17756c1ff4abec0, role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=e13bb57123f8483b9d6f24c63738d6be) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:13.481976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:13.483416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:13.489929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 192/372] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:13 2022] GET /identity/v3/role_assignments?group.id=e86ffdc28199461bb17756c1ff4abec0&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=0e7d21c594094cef90457df82be0bce6 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:13.490892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.563523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fb0ed-849b-49a6-a06e-4f644c321267 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.604719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db120a0c-24ff-4ced-b8f4-fc5bef203073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.605503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db120a0c-24ff-4ced-b8f4-fc5bef203073 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.605734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db120a0c-24ff-4ced-b8f4-fc5bef203073 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.606156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db120a0c-24ff-4ced-b8f4-fc5bef203073 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.607362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db120a0c-24ff-4ced-b8f4-fc5bef203073 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:13.609000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db120a0c-24ff-4ced-b8f4-fc5bef203073 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:13.612388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 181/373] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:13 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:13.616092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:13.618460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db120a0c-24ff-4ced-b8f4-fc5bef203073 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.620306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766492ed-b6eb-439a-8fa7-800fde20f253 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.654941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:13.663316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.664487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.664896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.665171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.666615 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:13.666929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:13.669366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:13.683149 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 193/374] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:13.690023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.759127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db120a0c-24ff-4ced-b8f4-fc5bef203073 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.821804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8959d-d676-4e9d-9991-1801b4d8d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.823820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8959d-d676-4e9d-9991-1801b4d8d110 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.824546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8959d-d676-4e9d-9991-1801b4d8d110 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.826122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8959d-d676-4e9d-9991-1801b4d8d110 None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.827674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8959d-d676-4e9d-9991-1801b4d8d110 None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:13.830177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8959d-d676-4e9d-9991-1801b4d8d110 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:13.832654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 182/375] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:13 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:13.839365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8959d-d676-4e9d-9991-1801b4d8d110 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:13.845844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131926d6-9270-4e69-834e-87d122aaa5f0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.908068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abc59-5eb8-4097-86bd-abb4e0cd2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.909109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abc59-5eb8-4097-86bd-abb4e0cd2b37 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.913863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abc59-5eb8-4097-86bd-abb4e0cd2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.914377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13abc59-5eb8-4097-86bd-abb4e0cd2b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.946221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:13.955634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8959d-d676-4e9d-9991-1801b4d8d110 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:13.966594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:13.996489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:13.997097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:13.997373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:13.997660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:13.998397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] RBAC: Adding query filter params (group.id=e86ffdc28199461bb17756c1ff4abec0, role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=28150185d6e141fcb8b89982937b34cb) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:13.998697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:14.001881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:14.015502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 183/376] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:13 2022] GET /identity/v3/role_assignments?group.id=e86ffdc28199461bb17756c1ff4abec0&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=0e7d21c594094cef90457df82be0bce6 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:14.037486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13abc59-5eb8-4097-86bd-abb4e0cd2b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:14.039076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13abc59-5eb8-4097-86bd-abb4e0cd2b37 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:14.157254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 194/377] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:14.163485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:14.304361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867a1a1-d476-45e0-bbda-78a18cb5d22c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:14.341333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0ead-dd0a-43e7-9be5-157a4ee03e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:14.342001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0ead-dd0a-43e7-9be5-157a4ee03e40 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:14.342276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0ead-dd0a-43e7-9be5-157a4ee03e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:14.342545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0ead-dd0a-43e7-9be5-157a4ee03e40 None admin] PATH_INFO: `/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:14.343715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d0ead-dd0a-43e7-9be5-157a4ee03e40 None admin] RBAC: Authorizing `identity:get_project(project_id=0c2a01d2eee64cb9a559a6d537ff97c8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:14.345163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d0ead-dd0a-43e7-9be5-157a4ee03e40 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:14.347135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 184/378] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:14 2022] GET /identity/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:14.352641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abc59-5eb8-4097-86bd-abb4e0cd2b37 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:14.412924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:14.455283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13abc59-5eb8-4097-86bd-abb4e0cd2b37 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:14.490045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e260e-82b7-4d9c-8aab-1dc9b881c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:14.490685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e260e-82b7-4d9c-8aab-1dc9b881c10e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:14.490940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e260e-82b7-4d9c-8aab-1dc9b881c10e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:14.491209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e260e-82b7-4d9c-8aab-1dc9b881c10e None admin] PATH_INFO: `/v3/groups/1fae68b248d443c7894538b39aead6ba` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:14.498490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e260e-82b7-4d9c-8aab-1dc9b881c10e None admin] RBAC: Authorizing `identity:get_group(group_id=1fae68b248d443c7894538b39aead6ba)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:14.500004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e260e-82b7-4d9c-8aab-1dc9b881c10e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:14.501981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 195/379] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:14 2022] GET /identity/v3/groups/1fae68b248d443c7894538b39aead6ba => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:14.511132 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0ead-dd0a-43e7-9be5-157a4ee03e40 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:14.536107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:14.635029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0ead-dd0a-43e7-9be5-157a4ee03e40 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:14.669786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ce09a-7c0b-4141-89aa-8b6289ac1784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:14.670396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ce09a-7c0b-4141-89aa-8b6289ac1784 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:14.670728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ce09a-7c0b-4141-89aa-8b6289ac1784 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:14.670999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ce09a-7c0b-4141-89aa-8b6289ac1784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:14.671718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ce09a-7c0b-4141-89aa-8b6289ac1784 None admin] RBAC: Adding query filter params (group.id=1fae68b248d443c7894538b39aead6ba, role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=0c2a01d2eee64cb9a559a6d537ff97c8) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:14.672018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ce09a-7c0b-4141-89aa-8b6289ac1784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:14.673553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ce09a-7c0b-4141-89aa-8b6289ac1784 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:14.679628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 185/380] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:14 2022] GET /identity/v3/role_assignments?group.id=1fae68b248d443c7894538b39aead6ba&scope.project.id=0c2a01d2eee64cb9a559a6d537ff97c8&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:14.818500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d830d4-7695-48a7-96bc-77ada3fa63a2 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:14.818889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d830d4-7695-48a7-96bc-77ada3fa63a2 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:14.819061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d830d4-7695-48a7-96bc-77ada3fa63a2 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:14.820592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 196/381] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:14.826523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93867ab0-a254-4ea8-9fde-c04282db801d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:14.826809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93867ab0-a254-4ea8-9fde-c04282db801d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:14.827083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93867ab0-a254-4ea8-9fde-c04282db801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:14.846472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-93867ab0-a254-4ea8-9fde-c04282db801d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:14.847649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-93867ab0-a254-4ea8-9fde-c04282db801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:14.931754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 186/382] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:15.365449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d830d4-7695-48a7-96bc-77ada3fa63a2 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:15.495418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d830d4-7695-48a7-96bc-77ada3fa63a2 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:15.530612 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:15.544008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfce1dc-094e-49ce-8cfb-94f41d881a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:15.544648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce1dc-094e-49ce-8cfb-94f41d881a1e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:15.544933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce1dc-094e-49ce-8cfb-94f41d881a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:15.545209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce1dc-094e-49ce-8cfb-94f41d881a1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:15.562427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfce1dc-094e-49ce-8cfb-94f41d881a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-bdfce1dc-094e-49ce-8cfb-94f41d881a1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:15.567352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:15.569485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:15.571487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 197/383] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:15.578703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93867ab0-a254-4ea8-9fde-c04282db801d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:15.603973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:15.722527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93867ab0-a254-4ea8-9fde-c04282db801d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:15.767929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7766-074c-4381-9a2a-9e1d2243a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:15.768554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7766-074c-4381-9a2a-9e1d2243a17d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:15.768833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7766-074c-4381-9a2a-9e1d2243a17d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:15.769107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7766-074c-4381-9a2a-9e1d2243a17d None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:15.769802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7766-074c-4381-9a2a-9e1d2243a17d None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:15.770104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7766-074c-4381-9a2a-9e1d2243a17d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:15.771531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7766-074c-4381-9a2a-9e1d2243a17d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:15.784464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 187/384] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:15.790089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfce1dc-094e-49ce-8cfb-94f41d881a1e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:15.848265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f530d3-3337-443b-aa5d-258c0a492c12 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:15.848586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f530d3-3337-443b-aa5d-258c0a492c12 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:15.848929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f530d3-3337-443b-aa5d-258c0a492c12 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:15.851128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 188/385] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:15.857494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25070d9e-7755-4ec1-9149-5e261acfd1cc None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:15.857871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25070d9e-7755-4ec1-9149-5e261acfd1cc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:15.858148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25070d9e-7755-4ec1-9149-5e261acfd1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:15.881296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-25070d9e-7755-4ec1-9149-5e261acfd1cc None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:15.882515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-25070d9e-7755-4ec1-9149-5e261acfd1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:15.976944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfce1dc-094e-49ce-8cfb-94f41d881a1e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:16.002295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 189/386] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:16.034793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e775-1822-4ebb-82bd-882eaaeae8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:16.035439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e775-1822-4ebb-82bd-882eaaeae8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.035721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e775-1822-4ebb-82bd-882eaaeae8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.035993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e775-1822-4ebb-82bd-882eaaeae8b9 None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.037109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e775-1822-4ebb-82bd-882eaaeae8b9 None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:16.038583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709e775-1822-4ebb-82bd-882eaaeae8b9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:16.040399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 198/387] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:15 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:16.045820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25070d9e-7755-4ec1-9149-5e261acfd1cc None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:16.059663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:16.171346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25070d9e-7755-4ec1-9149-5e261acfd1cc None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:16.208195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c6277-d945-4dba-ae0f-87933532f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:16.208840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6277-d945-4dba-ae0f-87933532f94b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.209117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6277-d945-4dba-ae0f-87933532f94b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.209389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c6277-d945-4dba-ae0f-87933532f94b None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.210585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c6277-d945-4dba-ae0f-87933532f94b None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:16.212154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c6277-d945-4dba-ae0f-87933532f94b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:16.214646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 190/388] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:16 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:16.220282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e775-1822-4ebb-82bd-882eaaeae8b9 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:16.262980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00341f3-6f4c-4a84-89f3-bb95fef0552c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.263168 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00341f3-6f4c-4a84-89f3-bb95fef0552c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.263432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00341f3-6f4c-4a84-89f3-bb95fef0552c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.265063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 191/389] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:16.270167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2349-a4f5-46c3-aac5-8db77693afcf None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.270486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2349-a4f5-46c3-aac5-8db77693afcf None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.270724 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a2349-a4f5-46c3-aac5-8db77693afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.297695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0d3a2349-a4f5-46c3-aac5-8db77693afcf None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:16.298899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0d3a2349-a4f5-46c3-aac5-8db77693afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:16.307011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:16.402062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e775-1822-4ebb-82bd-882eaaeae8b9 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:16.413279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 192/390] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:16.414373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a2349-a4f5-46c3-aac5-8db77693afcf None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:16.422769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:16.448069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd5286-5352-4796-bf85-1becacf9a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:16.448751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5286-5352-4796-bf85-1becacf9a1f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.449034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5286-5352-4796-bf85-1becacf9a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.449312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd5286-5352-4796-bf85-1becacf9a1f5 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be/groups/e86ffdc28199461bb17756c1ff4abec0/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.452257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd5286-5352-4796-bf85-1becacf9a1f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e13bb57123f8483b9d6f24c63738d6be, group_id=e86ffdc28199461bb17756c1ff4abec0, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:16.453753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd5286-5352-4796-bf85-1becacf9a1f5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:16.517843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a2349-a4f5-46c3-aac5-8db77693afcf None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:16.524926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 199/391] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Aug 23 16:16:16 2022] PUT /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be/groups/e86ffdc28199461bb17756c1ff4abec0/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:16.527198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3477bbc-53b5-4eee-9f1e-b00a1e9d9780 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.527900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3477bbc-53b5-4eee-9f1e-b00a1e9d9780 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.528395 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3477bbc-53b5-4eee-9f1e-b00a1e9d9780 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.533931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 200/392] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:16.537344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c25e77-31a0-4283-9345-e094d95e7220 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.538044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c25e77-31a0-4283-9345-e094d95e7220 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.538529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c25e77-31a0-4283-9345-e094d95e7220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.557131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eda51-4be3-44cf-9094-c4b8a081a5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:16.557833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eda51-4be3-44cf-9094-c4b8a081a5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.558200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eda51-4be3-44cf-9094-c4b8a081a5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.558560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eda51-4be3-44cf-9094-c4b8a081a5a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.563066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-40c25e77-31a0-4283-9345-e094d95e7220 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:16.565037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-40c25e77-31a0-4283-9345-e094d95e7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:16.570742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eda51-4be3-44cf-9094-c4b8a081a5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ef6eda51-4be3-44cf-9094-c4b8a081a5a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:16.575774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:16.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:16.577984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:16.581761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 193/393] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:16.583256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eda51-4be3-44cf-9094-c4b8a081a5a1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:16.648645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 201/394] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:16.658153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:16.693217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c25e77-31a0-4283-9345-e094d95e7220 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:16.696087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eda51-4be3-44cf-9094-c4b8a081a5a1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:16.734946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:16.735581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.735925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.736203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.737178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:16.737544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:16.739004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:16.752761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 194/395] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:16.754703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:16.782514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:16.843268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c25e77-31a0-4283-9345-e094d95e7220 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:16.867497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0ce7-ce5f-4095-aabc-4393b0d1cae3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:16.885702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65796522-17e1-4c9b-bd4c-62d19cfdf7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:16.886352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796522-17e1-4c9b-bd4c-62d19cfdf7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.886635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796522-17e1-4c9b-bd4c-62d19cfdf7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.887042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796522-17e1-4c9b-bd4c-62d19cfdf7c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.898288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:16.898819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65796522-17e1-4c9b-bd4c-62d19cfdf7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-65796522-17e1-4c9b-bd4c-62d19cfdf7c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:16.904777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:16.905898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:16.906908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:16.909290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 202/396] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:16:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:16.909401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8639a-d2ae-475a-b0ee-80181a7355df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:16.917632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8639a-d2ae-475a-b0ee-80181a7355df None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:16.917632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8639a-d2ae-475a-b0ee-80181a7355df None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:16.917632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8639a-d2ae-475a-b0ee-80181a7355df None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:16.917632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8639a-d2ae-475a-b0ee-80181a7355df None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:16.917632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8639a-d2ae-475a-b0ee-80181a7355df None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:16.919011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65796522-17e1-4c9b-bd4c-62d19cfdf7c5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:16.920275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 195/397] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:16 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:16.921386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8639a-d2ae-475a-b0ee-80181a7355df None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.030251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8639a-d2ae-475a-b0ee-80181a7355df None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.053555 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65796522-17e1-4c9b-bd4c-62d19cfdf7c5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.056382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:17.069657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb03d27-a27c-4062-bb07-76f872bc4ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.072361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb03d27-a27c-4062-bb07-76f872bc4ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.072361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb03d27-a27c-4062-bb07-76f872bc4ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.072361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb03d27-a27c-4062-bb07-76f872bc4ce9 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.072616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb03d27-a27c-4062-bb07-76f872bc4ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:17.073990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb03d27-a27c-4062-bb07-76f872bc4ce9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:17.075925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 196/398] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:16 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:17.078747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb03d27-a27c-4062-bb07-76f872bc4ce9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.090800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6625f5-cf23-4c14-84b3-7e42f1374db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.091632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6625f5-cf23-4c14-84b3-7e42f1374db8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.092026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6625f5-cf23-4c14-84b3-7e42f1374db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.092627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6625f5-cf23-4c14-84b3-7e42f1374db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.093773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6625f5-cf23-4c14-84b3-7e42f1374db8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:17.094083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6625f5-cf23-4c14-84b3-7e42f1374db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:17.095475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6625f5-cf23-4c14-84b3-7e42f1374db8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:17.113228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 203/399] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:17.113228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a4f1b-3f1d-4073-b0bd-b2854fd6cf28 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.113228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a4f1b-3f1d-4073-b0bd-b2854fd6cf28 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.113228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a4f1b-3f1d-4073-b0bd-b2854fd6cf28 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.113228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 204/400] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:17.113228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a4f1b-3f1d-4073-b0bd-b2854fd6cf28 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.148834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:17.186555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb03d27-a27c-4062-bb07-76f872bc4ce9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.222841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc70a7b-fb84-4824-8059-22284efb3f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.223475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc70a7b-fb84-4824-8059-22284efb3f6b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.223756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc70a7b-fb84-4824-8059-22284efb3f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.224025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc70a7b-fb84-4824-8059-22284efb3f6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.228972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a4f1b-3f1d-4073-b0bd-b2854fd6cf28 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.234767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc70a7b-fb84-4824-8059-22284efb3f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-fbc70a7b-fb84-4824-8059-22284efb3f6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:17.240276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:17.241231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:17.242384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 197/401] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:16:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:17.243097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbfb4-2b62-4c31-bd70-93c39e6903aa None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.243097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbfb4-2b62-4c31-bd70-93c39e6903aa None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.243097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbfb4-2b62-4c31-bd70-93c39e6903aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.261675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3f7cbfb4-2b62-4c31-bd70-93c39e6903aa None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:17.262874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3f7cbfb4-2b62-4c31-bd70-93c39e6903aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:17.271858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac8571-1296-4744-abf0-beffed01b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.272527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8571-1296-4744-abf0-beffed01b9e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.272812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8571-1296-4744-abf0-beffed01b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.273084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8571-1296-4744-abf0-beffed01b9e6 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb/groups/e86ffdc28199461bb17756c1ff4abec0/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.275649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac8571-1296-4744-abf0-beffed01b9e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=28150185d6e141fcb8b89982937b34cb, group_id=e86ffdc28199461bb17756c1ff4abec0, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:17.277098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac8571-1296-4744-abf0-beffed01b9e6 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:17.329834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 198/402] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:17.330705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbfb4-2b62-4c31-bd70-93c39e6903aa None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.372035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 205/403] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Aug 23 16:16:17 2022] PUT /identity/v3/projects/28150185d6e141fcb8b89982937b34cb/groups/e86ffdc28199461bb17756c1ff4abec0/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:17.378956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac8571-1296-4744-abf0-beffed01b9e6 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.404407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:17.447422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:17.463029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbfb4-2b62-4c31-bd70-93c39e6903aa None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.505488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb23c39-24ce-4847-94ce-ce9a59e2274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.506907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23c39-24ce-4847-94ce-ce9a59e2274d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.507430 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23c39-24ce-4847-94ce-ce9a59e2274d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.507890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23c39-24ce-4847-94ce-ce9a59e2274d None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.509940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb23c39-24ce-4847-94ce-ce9a59e2274d None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:17.511945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb23c39-24ce-4847-94ce-ce9a59e2274d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:17.514415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 199/404] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:17 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:17.520230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb23c39-24ce-4847-94ce-ce9a59e2274d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.595579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac8571-1296-4744-abf0-beffed01b9e6 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.645083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.645726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.646009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.646282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.646951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:17.647256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:17.648642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:17.658065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 206/405] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:17.663178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.683845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb23c39-24ce-4847-94ce-ce9a59e2274d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.715210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:17.730217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33439632-3cb1-42bf-a731-bbf5c8d245f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.731560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439632-3cb1-42bf-a731-bbf5c8d245f1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.736128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439632-3cb1-42bf-a731-bbf5c8d245f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.736128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33439632-3cb1-42bf-a731-bbf5c8d245f1 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.736128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33439632-3cb1-42bf-a731-bbf5c8d245f1 None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:17.736128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33439632-3cb1-42bf-a731-bbf5c8d245f1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:17.743316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 200/406] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:17 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:17.743316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33439632-3cb1-42bf-a731-bbf5c8d245f1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.774036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:17.779378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ebaa6-e18c-4714-a338-1a11a5688acd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.817293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df5461-d7d4-4a17-b1d5-cd857ded019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.817980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df5461-d7d4-4a17-b1d5-cd857ded019e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.818264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df5461-d7d4-4a17-b1d5-cd857ded019e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.818589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df5461-d7d4-4a17-b1d5-cd857ded019e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.829979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df5461-d7d4-4a17-b1d5-cd857ded019e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-11df5461-d7d4-4a17-b1d5-cd857ded019e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:17.835346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:17.842762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 207/407] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:17.843564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df5461-d7d4-4a17-b1d5-cd857ded019e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.889911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33439632-3cb1-42bf-a731-bbf5c8d245f1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:17.937597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce334-0e4e-40ff-b640-c5db6650941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:17.938776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce334-0e4e-40ff-b640-c5db6650941a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:17.939062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce334-0e4e-40ff-b640-c5db6650941a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:17.939332 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce334-0e4e-40ff-b640-c5db6650941a None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:17.940745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ce334-0e4e-40ff-b640-c5db6650941a None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:17.942400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ce334-0e4e-40ff-b640-c5db6650941a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:17.944915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 201/408] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:17 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:17.951871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce334-0e4e-40ff-b640-c5db6650941a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:17.981805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df5461-d7d4-4a17-b1d5-cd857ded019e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:18.025587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5538-cd3d-49f8-a2a2-4440fabc2a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:18.026272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5538-cd3d-49f8-a2a2-4440fabc2a7d None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.029183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5538-cd3d-49f8-a2a2-4440fabc2a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.029183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5538-cd3d-49f8-a2a2-4440fabc2a7d None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be/groups/e86ffdc28199461bb17756c1ff4abec0/roles/0e7d21c594094cef90457df82be0bce6` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.033422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a5538-cd3d-49f8-a2a2-4440fabc2a7d None admin] RBAC: Authorizing `identity:create_grant(project_id=e13bb57123f8483b9d6f24c63738d6be, group_id=e86ffdc28199461bb17756c1ff4abec0, role_id=0e7d21c594094cef90457df82be0bce6)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:18.034960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a5538-cd3d-49f8-a2a2-4440fabc2a7d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:18.036288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:18.085243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce334-0e4e-40ff-b640-c5db6650941a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:18.117323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 208/409] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Aug 23 16:16:17 2022] PUT /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be/groups/e86ffdc28199461bb17756c1ff4abec0/roles/0e7d21c594094cef90457df82be0bce6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:18.119888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5538-cd3d-49f8-a2a2-4440fabc2a7d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:18.138878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:18.146507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:18.147367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.148279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.149176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.151026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:18.151494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:18.156307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:18.181667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 202/410] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:18.183074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:18.281638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5538-cd3d-49f8-a2a2-4440fabc2a7d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:18.319604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6591a3d-12a6-4bd8-b8de-6c8c1555e269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:18.320418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6591a3d-12a6-4bd8-b8de-6c8c1555e269 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.320797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6591a3d-12a6-4bd8-b8de-6c8c1555e269 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.321179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6591a3d-12a6-4bd8-b8de-6c8c1555e269 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.323130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6591a3d-12a6-4bd8-b8de-6c8c1555e269 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:18.324766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6591a3d-12a6-4bd8-b8de-6c8c1555e269 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:18.326819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 209/411] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:18 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:18.332895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6591a3d-12a6-4bd8-b8de-6c8c1555e269 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:18.356364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ec09-51f4-4c2c-8205-63f8ba4ebbe9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:18.383211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:18.404325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9273-efac-495e-b384-8f8c7c77497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:18.404325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9273-efac-495e-b384-8f8c7c77497d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.404325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9273-efac-495e-b384-8f8c7c77497d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.404325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b9273-efac-495e-b384-8f8c7c77497d None admin] PATH_INFO: `/v3/groups/1fae68b248d443c7894538b39aead6ba` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.406222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b9273-efac-495e-b384-8f8c7c77497d None admin] RBAC: Authorizing `identity:get_group(group_id=1fae68b248d443c7894538b39aead6ba)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:18.407662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b9273-efac-495e-b384-8f8c7c77497d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:18.409727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 203/412] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:18 2022] GET /identity/v3/groups/1fae68b248d443c7894538b39aead6ba => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:18.414920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9273-efac-495e-b384-8f8c7c77497d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:18.428189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:18.460199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6591a3d-12a6-4bd8-b8de-6c8c1555e269 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:18.500080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157da8c-1693-4626-95a1-15ab5b0400a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:18.500749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157da8c-1693-4626-95a1-15ab5b0400a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.501031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157da8c-1693-4626-95a1-15ab5b0400a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.501415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157da8c-1693-4626-95a1-15ab5b0400a7 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb/groups/e86ffdc28199461bb17756c1ff4abec0/roles/0e7d21c594094cef90457df82be0bce6` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.504367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157da8c-1693-4626-95a1-15ab5b0400a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=28150185d6e141fcb8b89982937b34cb, group_id=e86ffdc28199461bb17756c1ff4abec0, role_id=0e7d21c594094cef90457df82be0bce6)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:18.505872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157da8c-1693-4626-95a1-15ab5b0400a7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:18.556743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b9273-efac-495e-b384-8f8c7c77497d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:18.595095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720ac0-f40a-41ef-84b8-ddfb012a0fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:18.600447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720ac0-f40a-41ef-84b8-ddfb012a0fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.600447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720ac0-f40a-41ef-84b8-ddfb012a0fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.600447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720ac0-f40a-41ef-84b8-ddfb012a0fc8 None admin] PATH_INFO: `/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.600447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720ac0-f40a-41ef-84b8-ddfb012a0fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=0c2a01d2eee64cb9a559a6d537ff97c8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:18.600447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720ac0-f40a-41ef-84b8-ddfb012a0fc8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:18.601130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 204/413] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:18 2022] GET /identity/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:18.606358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720ac0-f40a-41ef-84b8-ddfb012a0fc8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:18.623976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 210/414] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Aug 23 16:16:18 2022] PUT /identity/v3/projects/28150185d6e141fcb8b89982937b34cb/groups/e86ffdc28199461bb17756c1ff4abec0/roles/0e7d21c594094cef90457df82be0bce6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:16:18.678408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:18.726755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720ac0-f40a-41ef-84b8-ddfb012a0fc8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:18.765032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b8f6-375b-4dbe-861a-e4e799bd9623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:18.765730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b8f6-375b-4dbe-861a-e4e799bd9623 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.766021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b8f6-375b-4dbe-861a-e4e799bd9623 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.766300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b8f6-375b-4dbe-861a-e4e799bd9623 None admin] PATH_INFO: `/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8/groups/1fae68b248d443c7894538b39aead6ba/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.768287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9b8f6-375b-4dbe-861a-e4e799bd9623 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c2a01d2eee64cb9a559a6d537ff97c8, group_id=1fae68b248d443c7894538b39aead6ba, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:18.769875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9b8f6-375b-4dbe-861a-e4e799bd9623 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:18.814477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996990fd-9018-4e6b-bcd0-9bcd86e1462e None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.814823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996990fd-9018-4e6b-bcd0-9bcd86e1462e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.815039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996990fd-9018-4e6b-bcd0-9bcd86e1462e None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.816772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 211/415] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:18.823949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3a43-e58a-4619-9acd-559854231be5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:18.823949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3a43-e58a-4619-9acd-559854231be5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:18.823949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3a43-e58a-4619-9acd-559854231be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:18.837838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 205/416] 10.222.0.61 () {58 vars in 1442 bytes} [Tue Aug 23 16:16:18 2022] PUT /identity/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8/groups/1fae68b248d443c7894538b39aead6ba/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:16:18.845591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-fd0d3a43-e58a-4619-9acd-559854231be5 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:18.846868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fd0d3a43-e58a-4619-9acd-559854231be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:18.934945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 212/417] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:19.248689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b8f6-375b-4dbe-861a-e4e799bd9623 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:19.357798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b8f6-375b-4dbe-861a-e4e799bd9623 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:19.379322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:19.393670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee8d8e-4381-48f5-a467-6a999179e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:19.398025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8d8e-4381-48f5-a467-6a999179e570 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:19.398025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8d8e-4381-48f5-a467-6a999179e570 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:19.398025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8d8e-4381-48f5-a467-6a999179e570 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:19.406301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee8d8e-4381-48f5-a467-6a999179e570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9fee8d8e-4381-48f5-a467-6a999179e570 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:19.411123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:19.412030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:19.412886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 206/418] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:19.418783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d3a43-e58a-4619-9acd-559854231be5 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:19.524343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:19.551395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1b599-dbdf-46f8-83e0-b8417ef930f8 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:19.551745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1b599-dbdf-46f8-83e0-b8417ef930f8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:19.551954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1b599-dbdf-46f8-83e0-b8417ef930f8 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:19.554449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 207/419] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:19.559203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81028d-fd07-4f69-99e0-bc5eaa332cfe None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:19.559675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81028d-fd07-4f69-99e0-bc5eaa332cfe None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:19.559962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81028d-fd07-4f69-99e0-bc5eaa332cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:19.578337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d3a43-e58a-4619-9acd-559854231be5 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:19.592295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0d81028d-fd07-4f69-99e0-bc5eaa332cfe None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:19.593537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0d81028d-fd07-4f69-99e0-bc5eaa332cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:19.639207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:19.639895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:19.640101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:19.640375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:19.641045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] RBAC: Adding query filter params (name=member) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:19.641351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:19.642765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:19.660354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 213/420] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:19.662645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:19.729145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 208/421] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:19.791189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187a7a4-1c70-4136-94a8-ffd7a6ca95de None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:19.828091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:19.838026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684ce89-7cc7-4497-b681-4b57c01a9e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:19.838691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684ce89-7cc7-4497-b681-4b57c01a9e3b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:19.838971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684ce89-7cc7-4497-b681-4b57c01a9e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:19.839240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684ce89-7cc7-4497-b681-4b57c01a9e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:19.919439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684ce89-7cc7-4497-b681-4b57c01a9e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:19.920908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684ce89-7cc7-4497-b681-4b57c01a9e3b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:20.034836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81028d-fd07-4f69-99e0-bc5eaa332cfe None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:20.082220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 214/422] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:16:20.089335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684ce89-7cc7-4497-b681-4b57c01a9e3b None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:20.133827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:20.215896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81028d-fd07-4f69-99e0-bc5eaa332cfe None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:20.225696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:20.254344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684ce89-7cc7-4497-b681-4b57c01a9e3b None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:20.278255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9727966-471c-4271-b631-ad7101a8fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:20.278915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9727966-471c-4271-b631-ad7101a8fd8d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.279194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9727966-471c-4271-b631-ad7101a8fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.279465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9727966-471c-4271-b631-ad7101a8fd8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.302086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9727966-471c-4271-b631-ad7101a8fd8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d9727966-471c-4271-b631-ad7101a8fd8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:20.307912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:20.308809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:20.309796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 209/423] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:20.315965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9727966-471c-4271-b631-ad7101a8fd8d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:20.322765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6dd4c-f3db-4195-a3f9-b1ebca184028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:20.323629 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6dd4c-f3db-4195-a3f9-b1ebca184028 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.324071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6dd4c-f3db-4195-a3f9-b1ebca184028 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.324488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6dd4c-f3db-4195-a3f9-b1ebca184028 None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.326259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6dd4c-f3db-4195-a3f9-b1ebca184028 None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:20.331804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6dd4c-f3db-4195-a3f9-b1ebca184028 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:20.331804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 215/424] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:20 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:20.338530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6dd4c-f3db-4195-a3f9-b1ebca184028 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:20.474487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:20.482420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6dd4c-f3db-4195-a3f9-b1ebca184028 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:20.519120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cc4f4-8422-451f-af7d-1f02fc0678fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:20.519775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc4f4-8422-451f-af7d-1f02fc0678fb None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.520056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc4f4-8422-451f-af7d-1f02fc0678fb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.520331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc4f4-8422-451f-af7d-1f02fc0678fb None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.521520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cc4f4-8422-451f-af7d-1f02fc0678fb None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:20.523000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cc4f4-8422-451f-af7d-1f02fc0678fb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:20.525085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 216/425] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:20 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:20.533087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cc4f4-8422-451f-af7d-1f02fc0678fb None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:20.545676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9727966-471c-4271-b631-ad7101a8fd8d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:20.587519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:20.588133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.588414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.588688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.589357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:20.589682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:20.591824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:20.605964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 210/426] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:16:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:20.608202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:20.662094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:20.711515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cc4f4-8422-451f-af7d-1f02fc0678fb None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:20.747881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbb719-f2b9-4c12-b7cf-fb4a49ec89d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:20.748490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb719-f2b9-4c12-b7cf-fb4a49ec89d8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.748781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb719-f2b9-4c12-b7cf-fb4a49ec89d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.749037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbb719-f2b9-4c12-b7cf-fb4a49ec89d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.749792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb719-f2b9-4c12-b7cf-fb4a49ec89d8 None admin] RBAC: Adding query filter params (group.id=e86ffdc28199461bb17756c1ff4abec0, role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=e13bb57123f8483b9d6f24c63738d6be) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:20.750099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb719-f2b9-4c12-b7cf-fb4a49ec89d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:20.751521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbb719-f2b9-4c12-b7cf-fb4a49ec89d8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:20.762127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 217/427] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:20 2022] GET /identity/v3/role_assignments?group.id=e86ffdc28199461bb17756c1ff4abec0&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:20.762127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51119f-d176-4f77-9f7d-d9dd9bab333a None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.762127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51119f-d176-4f77-9f7d-d9dd9bab333a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.762127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51119f-d176-4f77-9f7d-d9dd9bab333a None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.762127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 218/428] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:20.768513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ee39-9822-449c-80b5-982656c24d1e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.768802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ee39-9822-449c-80b5-982656c24d1e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.769056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36ee39-9822-449c-80b5-982656c24d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.771590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077db87d-2ab8-4d3a-b20a-1291d9134d96 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:20.804733 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-cf36ee39-9822-449c-80b5-982656c24d1e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:20.805963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cf36ee39-9822-449c-80b5-982656c24d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:20.854066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9466e4c-2ab7-4329-8e28-be5855173098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:20.854257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:20.855182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9466e4c-2ab7-4329-8e28-be5855173098 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:20.855182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9466e4c-2ab7-4329-8e28-be5855173098 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:20.855450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9466e4c-2ab7-4329-8e28-be5855173098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:20.956236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 219/429] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:20.971197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9466e4c-2ab7-4329-8e28-be5855173098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:20.972785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9466e4c-2ab7-4329-8e28-be5855173098 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:21.001787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:21.073824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b25f6d-b5c5-44ae-b545-f3c8378a8033 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.074106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b25f6d-b5c5-44ae-b545-f3c8378a8033 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.074396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b25f6d-b5c5-44ae-b545-f3c8378a8033 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.075882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 220/430] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:21.080073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 211/431] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:21.081490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54db9-7ebf-40b0-bc01-c3164a273cc9 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.081800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54db9-7ebf-40b0-bc01-c3164a273cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.082076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54db9-7ebf-40b0-bc01-c3164a273cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.086312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9466e4c-2ab7-4329-8e28-be5855173098 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.102135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d1e54db9-7ebf-40b0-bc01-c3164a273cc9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:21.104272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d1e54db9-7ebf-40b0-bc01-c3164a273cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:21.188417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 221/432] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:21.216540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9466e4c-2ab7-4329-8e28-be5855173098 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.250282 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:21.254865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6de81-5ff8-4aed-8a2b-ec26d8171660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.255870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6de81-5ff8-4aed-8a2b-ec26d8171660 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.256333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6de81-5ff8-4aed-8a2b-ec26d8171660 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.256597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6de81-5ff8-4aed-8a2b-ec26d8171660 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.257550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0979-6045-4639-9f65-fdbe92a77f9d None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.257858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6de81-5ff8-4aed-8a2b-ec26d8171660 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:21.257989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0979-6045-4639-9f65-fdbe92a77f9d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.258429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0979-6045-4639-9f65-fdbe92a77f9d None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.260164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6de81-5ff8-4aed-8a2b-ec26d8171660 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:21.260532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 222/433] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:21.262002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 212/434] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:21.267533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0979-6045-4639-9f65-fdbe92a77f9d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.270563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606099c4-ec67-403e-a2db-c6220c64858b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.271069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606099c4-ec67-403e-a2db-c6220c64858b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.271534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606099c4-ec67-403e-a2db-c6220c64858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.295906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-606099c4-ec67-403e-a2db-c6220c64858b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:21.297341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-606099c4-ec67-403e-a2db-c6220c64858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:21.374160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:21.390611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 213/435] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:21.391775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606099c4-ec67-403e-a2db-c6220c64858b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.395586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0979-6045-4639-9f65-fdbe92a77f9d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.434165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ede7-b9ea-4367-8aa0-ea41cf66dfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.435158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ede7-b9ea-4367-8aa0-ea41cf66dfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.435672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ede7-b9ea-4367-8aa0-ea41cf66dfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.436165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ede7-b9ea-4367-8aa0-ea41cf66dfc4 None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.438060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5ede7-b9ea-4367-8aa0-ea41cf66dfc4 None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:21.440135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5ede7-b9ea-4367-8aa0-ea41cf66dfc4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:21.442818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 223/436] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:21.450514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ede7-b9ea-4367-8aa0-ea41cf66dfc4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.508405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606099c4-ec67-403e-a2db-c6220c64858b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.559728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:21.569385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0974-396a-46b0-a6ac-e49a49618c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.572222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0974-396a-46b0-a6ac-e49a49618c19 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.572222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0974-396a-46b0-a6ac-e49a49618c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.572222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0974-396a-46b0-a6ac-e49a49618c19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.573900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ede7-b9ea-4367-8aa0-ea41cf66dfc4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.581539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0974-396a-46b0-a6ac-e49a49618c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d79f0974-396a-46b0-a6ac-e49a49618c19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:21.586649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:21.587725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:21.588548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:21.596071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 214/437] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:21.596071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0974-396a-46b0-a6ac-e49a49618c19 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.617271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.617908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.618656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.619460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.620195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] RBAC: Adding query filter params (group.id=e86ffdc28199461bb17756c1ff4abec0, role.id=c2202fa3e5ce4430b5c100bfd6c74f21, scope.project.id=28150185d6e141fcb8b89982937b34cb) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:21.620506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:21.621968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:21.627731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 224/438] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/role_assignments?group.id=e86ffdc28199461bb17756c1ff4abec0&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=c2202fa3e5ce4430b5c100bfd6c74f21 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:21.628448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.661579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:21.730133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0974-396a-46b0-a6ac-e49a49618c19 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.762267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d023f6d-d4a4-483c-b915-22064bdda269 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.768465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7ffee-9615-4312-a44e-9deaa0fc0c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.769112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7ffee-9615-4312-a44e-9deaa0fc0c68 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.769871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7ffee-9615-4312-a44e-9deaa0fc0c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.770148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7ffee-9615-4312-a44e-9deaa0fc0c68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.783272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7ffee-9615-4312-a44e-9deaa0fc0c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9fe7ffee-9615-4312-a44e-9deaa0fc0c68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:21.788661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:21.789794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 215/439] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:21.791523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7ffee-9615-4312-a44e-9deaa0fc0c68 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.801997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.802874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.803151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.803422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.804086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:21.804387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:21.805805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:21.816309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 225/440] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:21.817125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.851188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:21.905353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:21.909383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7ffee-9615-4312-a44e-9deaa0fc0c68 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.924285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21295cc-4881-437c-b2b2-76dc2d6342b0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:21.943496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac11bd2-d652-4193-be1d-020f38755e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.944128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11bd2-d652-4193-be1d-020f38755e72 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.944416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11bd2-d652-4193-be1d-020f38755e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.944688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11bd2-d652-4193-be1d-020f38755e72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.954673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac11bd2-d652-4193-be1d-020f38755e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:21.957414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:21.958042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:21.958325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:21.958598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:21.959260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-aac11bd2-d652-4193-be1d-020f38755e72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:21.959371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:21.960372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:21.961259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:21.961900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:21.961969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 216/441] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:21.962033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:21.962110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac11bd2-d652-4193-be1d-020f38755e72 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:21.972539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 226/442] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:21.973340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.070316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5c31-8119-442b-8a6c-50056dddb49d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.071655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac11bd2-d652-4193-be1d-020f38755e72 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.078417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.103846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.104450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.104732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.104843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc752d-f023-4e3c-8b36-8b1dacac27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.105262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.105346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc752d-f023-4e3c-8b36-8b1dacac27ef None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.105632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc752d-f023-4e3c-8b36-8b1dacac27ef None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.105730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:22.105896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc752d-f023-4e3c-8b36-8b1dacac27ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.105989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.107365 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.115646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 227/443] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:22.116435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.120279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.176341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc752d-f023-4e3c-8b36-8b1dacac27ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.177754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc752d-f023-4e3c-8b36-8b1dacac27ef None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.214031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9926f79-ab29-4ac1-a4a7-0312ec8d122c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.247795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89de80-a5b4-4fbe-907f-cbfc795cf1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.248409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89de80-a5b4-4fbe-907f-cbfc795cf1ac None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.248692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89de80-a5b4-4fbe-907f-cbfc795cf1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.248957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89de80-a5b4-4fbe-907f-cbfc795cf1ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.284813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 217/444] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:22.286105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc752d-f023-4e3c-8b36-8b1dacac27ef None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.296754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.316449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89de80-a5b4-4fbe-907f-cbfc795cf1ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.317951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89de80-a5b4-4fbe-907f-cbfc795cf1ac None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.320563 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.385837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc752d-f023-4e3c-8b36-8b1dacac27ef None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.417253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 228/445] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:22.417989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89de80-a5b4-4fbe-907f-cbfc795cf1ac None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.423212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4447-c8e5-4555-846e-435a93cee3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.423817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4447-c8e5-4555-846e-435a93cee3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.424095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4447-c8e5-4555-846e-435a93cee3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.424366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4447-c8e5-4555-846e-435a93cee3d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.489637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4447-c8e5-4555-846e-435a93cee3d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.491022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4447-c8e5-4555-846e-435a93cee3d1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.498889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.513218 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89de80-a5b4-4fbe-907f-cbfc795cf1ac None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.520584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.546018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c70f5b-2266-4936-8a4f-3d2633351dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.546633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70f5b-2266-4936-8a4f-3d2633351dbb None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.546912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70f5b-2266-4936-8a4f-3d2633351dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.547184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c70f5b-2266-4936-8a4f-3d2633351dbb None admin] PATH_INFO: `/v3/projects/e13bb57123f8483b9d6f24c63738d6be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.548369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c70f5b-2266-4936-8a4f-3d2633351dbb None admin] RBAC: Authorizing `identity:get_project(project_id=e13bb57123f8483b9d6f24c63738d6be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.549823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c70f5b-2266-4936-8a4f-3d2633351dbb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.551457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 229/446] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/projects/e13bb57123f8483b9d6f24c63738d6be => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:22.552205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c70f5b-2266-4936-8a4f-3d2633351dbb None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.591952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 218/447] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:22.592809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4447-c8e5-4555-846e-435a93cee3d1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.654496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c70f5b-2266-4936-8a4f-3d2633351dbb None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.687518 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed791c24-5219-4ce0-a945-6b0986cbf045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.688141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed791c24-5219-4ce0-a945-6b0986cbf045 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.688418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed791c24-5219-4ce0-a945-6b0986cbf045 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.688701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed791c24-5219-4ce0-a945-6b0986cbf045 None admin] PATH_INFO: `/v3/projects/28150185d6e141fcb8b89982937b34cb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.689832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed791c24-5219-4ce0-a945-6b0986cbf045 None admin] RBAC: Authorizing `identity:get_project(project_id=28150185d6e141fcb8b89982937b34cb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.691275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed791c24-5219-4ce0-a945-6b0986cbf045 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.691501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4447-c8e5-4555-846e-435a93cee3d1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.693058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 230/448] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/projects/28150185d6e141fcb8b89982937b34cb => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:22.693760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed791c24-5219-4ce0-a945-6b0986cbf045 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.699831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.726316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36cbc-7dac-470f-ab3c-f94d8cbc1df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.726964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36cbc-7dac-470f-ab3c-f94d8cbc1df9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.727219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36cbc-7dac-470f-ab3c-f94d8cbc1df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.727503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d36cbc-7dac-470f-ab3c-f94d8cbc1df9 None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.729310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d36cbc-7dac-470f-ab3c-f94d8cbc1df9 None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.730794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d36cbc-7dac-470f-ab3c-f94d8cbc1df9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.732931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 219/449] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:22.733751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36cbc-7dac-470f-ab3c-f94d8cbc1df9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.739442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.797437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed791c24-5219-4ce0-a945-6b0986cbf045 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.829470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26025207-3972-403c-8e3c-e861bc85a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.830123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025207-3972-403c-8e3c-e861bc85a613 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.830406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025207-3972-403c-8e3c-e861bc85a613 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.830679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025207-3972-403c-8e3c-e861bc85a613 None admin] PATH_INFO: `/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.839726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d36cbc-7dac-470f-ab3c-f94d8cbc1df9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.839898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26025207-3972-403c-8e3c-e861bc85a613 None admin] RBAC: Authorizing `identity:get_project(project_id=0c2a01d2eee64cb9a559a6d537ff97c8)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.839898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26025207-3972-403c-8e3c-e861bc85a613 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.839898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 231/450] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/projects/0c2a01d2eee64cb9a559a6d537ff97c8 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:22.839898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26025207-3972-403c-8e3c-e861bc85a613 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.867370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987123c-e1b8-4929-bc64-f60eb582a4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.868009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987123c-e1b8-4929-bc64-f60eb582a4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.868319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987123c-e1b8-4929-bc64-f60eb582a4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.868585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987123c-e1b8-4929-bc64-f60eb582a4d0 None admin] PATH_INFO: `/v3/groups/e86ffdc28199461bb17756c1ff4abec0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.869787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987123c-e1b8-4929-bc64-f60eb582a4d0 None admin] RBAC: Authorizing `identity:get_group(group_id=e86ffdc28199461bb17756c1ff4abec0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.871234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987123c-e1b8-4929-bc64-f60eb582a4d0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.872814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 220/451] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/groups/e86ffdc28199461bb17756c1ff4abec0 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:22.873570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987123c-e1b8-4929-bc64-f60eb582a4d0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.920411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.936136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26025207-3972-403c-8e3c-e861bc85a613 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:22.945695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:22.972756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:22.973363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:22.973681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:22.973958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:22.974759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] RBAC: Adding query filter params (group.id=e86ffdc28199461bb17756c1ff4abec0, role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=e13bb57123f8483b9d6f24c63738d6be) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:22.975065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:22.976603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:22.993649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 232/452] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/role_assignments?group.id=e86ffdc28199461bb17756c1ff4abec0&scope.project.id=e13bb57123f8483b9d6f24c63738d6be&role.id=0e7d21c594094cef90457df82be0bce6 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:22.993649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:22.993918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987123c-e1b8-4929-bc64-f60eb582a4d0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:23.051965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5369f-8fb3-47a6-a727-b33eb9676d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:23.052564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5369f-8fb3-47a6-a727-b33eb9676d94 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:23.052845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5369f-8fb3-47a6-a727-b33eb9676d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:23.056353 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5369f-8fb3-47a6-a727-b33eb9676d94 None admin] PATH_INFO: `/v3/groups/1fae68b248d443c7894538b39aead6ba` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:23.058844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5369f-8fb3-47a6-a727-b33eb9676d94 None admin] RBAC: Authorizing `identity:get_group(group_id=1fae68b248d443c7894538b39aead6ba)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:23.060363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5369f-8fb3-47a6-a727-b33eb9676d94 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:23.067510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 221/453] 10.222.0.61 () {56 vars in 1180 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/groups/1fae68b248d443c7894538b39aead6ba => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:23.068500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5369f-8fb3-47a6-a727-b33eb9676d94 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:23.154724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc8bcf-77c6-423a-9192-14d955a2c036 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:23.204800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf589e6f-8db2-4d4e-ab95-607442bc380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:23.205419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589e6f-8db2-4d4e-ab95-607442bc380f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:23.205732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589e6f-8db2-4d4e-ab95-607442bc380f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:23.206011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589e6f-8db2-4d4e-ab95-607442bc380f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:23.206874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589e6f-8db2-4d4e-ab95-607442bc380f None admin] RBAC: Adding query filter params (group.id=e86ffdc28199461bb17756c1ff4abec0, role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=28150185d6e141fcb8b89982937b34cb) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:23.207190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589e6f-8db2-4d4e-ab95-607442bc380f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:23.209728 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589e6f-8db2-4d4e-ab95-607442bc380f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:23.219080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 233/454] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:22 2022] GET /identity/v3/role_assignments?group.id=e86ffdc28199461bb17756c1ff4abec0&scope.project.id=28150185d6e141fcb8b89982937b34cb&role.id=0e7d21c594094cef90457df82be0bce6 => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:23.236057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5369f-8fb3-47a6-a727-b33eb9676d94 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:23.251382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:23.289812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b699f-e9a8-4e09-ac7e-b5c845168974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:23.290472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b699f-e9a8-4e09-ac7e-b5c845168974 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:23.290861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b699f-e9a8-4e09-ac7e-b5c845168974 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:23.291143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b699f-e9a8-4e09-ac7e-b5c845168974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:23.292232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b699f-e9a8-4e09-ac7e-b5c845168974 None admin] RBAC: Adding query filter params (group.id=1fae68b248d443c7894538b39aead6ba, role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=0c2a01d2eee64cb9a559a6d537ff97c8) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:23.292725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b699f-e9a8-4e09-ac7e-b5c845168974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:23.294654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b699f-e9a8-4e09-ac7e-b5c845168974 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:23.303821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 222/455] 10.222.0.61 () {56 vars in 1376 bytes} [Tue Aug 23 16:16:23 2022] GET /identity/v3/role_assignments?group.id=1fae68b248d443c7894538b39aead6ba&scope.project.id=0c2a01d2eee64cb9a559a6d537ff97c8&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:26.031457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329af5-c535-4c9a-bfe5-41158cc34cf1 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.031981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329af5-c535-4c9a-bfe5-41158cc34cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.031981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329af5-c535-4c9a-bfe5-41158cc34cf1 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.033620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 234/456] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:26.038918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5e90-eed0-4407-b8a2-39eb757b4d14 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.039355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5e90-eed0-4407-b8a2-39eb757b4d14 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.039464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc5e90-eed0-4407-b8a2-39eb757b4d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.061908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fdcc5e90-eed0-4407-b8a2-39eb757b4d14 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:26.063100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fdcc5e90-eed0-4407-b8a2-39eb757b4d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:26.107095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54819-a4a7-40ba-b4c7-5b95874c08e4 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.107599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54819-a4a7-40ba-b4c7-5b95874c08e4 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.108180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54819-a4a7-40ba-b4c7-5b95874c08e4 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.109964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 235/457] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:26.114958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bec79-094c-4dba-9a4e-4d83086d531c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.115472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bec79-094c-4dba-9a4e-4d83086d531c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.115962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bec79-094c-4dba-9a4e-4d83086d531c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.146769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-af2bec79-094c-4dba-9a4e-4d83086d531c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:26.148796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-af2bec79-094c-4dba-9a4e-4d83086d531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:26.150269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 223/458] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:26.194834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:26.247942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 236/459] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:26.305384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294f004-8207-4e39-81d0-195dc617197f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.306576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294f004-8207-4e39-81d0-195dc617197f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.307053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294f004-8207-4e39-81d0-195dc617197f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.308585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 224/460] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:26.314008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69f9d-9af0-464b-b749-8592b7c73432 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.314301 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69f9d-9af0-464b-b749-8592b7c73432 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.314578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a69f9d-9af0-464b-b749-8592b7c73432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.338766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e2a69f9d-9af0-464b-b749-8592b7c73432 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:26.339947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e2a69f9d-9af0-464b-b749-8592b7c73432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:26.431133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 237/461] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:26.469432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294f004-8207-4e39-81d0-195dc617197f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:26.477283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a496-52f7-4c35-aa00-1ba1161c5b53 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.477565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a496-52f7-4c35-aa00-1ba1161c5b53 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.478695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550a496-52f7-4c35-aa00-1ba1161c5b53 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.480543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 238/462] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:26.485833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46702fd6-f279-4133-bca3-53401fd15125 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.486364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46702fd6-f279-4133-bca3-53401fd15125 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.487117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46702fd6-f279-4133-bca3-53401fd15125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.514431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-46702fd6-f279-4133-bca3-53401fd15125 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:26.520402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-46702fd6-f279-4133-bca3-53401fd15125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:26.619557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 239/463] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:26.639525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46702fd6-f279-4133-bca3-53401fd15125 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:26.642405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294f004-8207-4e39-81d0-195dc617197f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:26.659820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:26.678417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:26.679364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.679859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.680346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.691342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:26.693104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:26.693950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:26.709169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:26.710139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:26.710983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:26.710983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:26.710983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:26.713572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 225/464] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:26.719666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:26.811959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46702fd6-f279-4133-bca3-53401fd15125 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:26.846898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65953775-28e3-4b40-8a95-233978c0261a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:26.847135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:26.848024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.848452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.848901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.860707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:26.862637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:26.880621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:26.881797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:26.882889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:26.882889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:26.882889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:26.884811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 240/465] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:26.885956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:26.893717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:26.894404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:26.894755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:26.895097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:26.895822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:26.896197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:26.898216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:26.917692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 226/466] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:26.918723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:26.939535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:26.980369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:27.002522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fb569-8b96-4a1f-8059-1520e893c1fa None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.029590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5217ad-3533-40da-acd9-f9f8aa94acc3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.041894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.042621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.042866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.043075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.054413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.057211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.066695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.067300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.067575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.068008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.068659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:27.068963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.070354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:27.074305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:27.075209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:27.076048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:27.076048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:27.076048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:27.076048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 241/467] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:27.077107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:27.092625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 227/468] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:27.092625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:27.172754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:27.188215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09393b92-a98a-4b10-8aae-d06e89bfcfad None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.197275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b63978-ebb8-495e-b1ad-862062bbfbd7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.216594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:27.222041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3456cd-423a-439f-a6a2-bacf9b98fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.222649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3456cd-423a-439f-a6a2-bacf9b98fedb None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.222929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3456cd-423a-439f-a6a2-bacf9b98fedb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.223203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3456cd-423a-439f-a6a2-bacf9b98fedb None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.223892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3456cd-423a-439f-a6a2-bacf9b98fedb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.225362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3456cd-423a-439f-a6a2-bacf9b98fedb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.230549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.231174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.231456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.231730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.242600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.244586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:27.258372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:27.260128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:27.260999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:27.260999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:27.260999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:27.260999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 228/469] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:27.260999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:27.331805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 242/470] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:16:27 2022] POST /identity/v3/users => generated 246 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:27.332593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3456cd-423a-439f-a6a2-bacf9b98fedb None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:27.360759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49895f4f-1162-4062-af7f-5c77d92f00c3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.392983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:27.401729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d9728-5704-4f12-b819-d31c5a9e9f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.402469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d9728-5704-4f12-b819-d31c5a9e9f6d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.402749 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d9728-5704-4f12-b819-d31c5a9e9f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.403124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d9728-5704-4f12-b819-d31c5a9e9f6d None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.403784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d9728-5704-4f12-b819-d31c5a9e9f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:27.404087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d9728-5704-4f12-b819-d31c5a9e9f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.405487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d9728-5704-4f12-b819-d31c5a9e9f6d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.419197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 229/471] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:27.420491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf362e62-c904-47e8-b717-76ecc0bbdaed None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.420774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf362e62-c904-47e8-b717-76ecc0bbdaed None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.421051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf362e62-c904-47e8-b717-76ecc0bbdaed None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.422488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 230/472] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:27.423186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf362e62-c904-47e8-b717-76ecc0bbdaed None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:27.454144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3456cd-423a-439f-a6a2-bacf9b98fedb None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.491780 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f49f2c-0867-47ba-882f-83a9397490be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.492560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49f2c-0867-47ba-882f-83a9397490be None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.492843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49f2c-0867-47ba-882f-83a9397490be None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.493120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f49f2c-0867-47ba-882f-83a9397490be None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.494394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f49f2c-0867-47ba-882f-83a9397490be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.495914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f49f2c-0867-47ba-882f-83a9397490be None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.545264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf362e62-c904-47e8-b717-76ecc0bbdaed None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.579710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f75113-101c-4f94-8767-b4be59461137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.580314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75113-101c-4f94-8767-b4be59461137 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.580593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75113-101c-4f94-8767-b4be59461137 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.580864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75113-101c-4f94-8767-b4be59461137 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.581504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f75113-101c-4f94-8767-b4be59461137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:27.581832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f75113-101c-4f94-8767-b4be59461137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.583210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f75113-101c-4f94-8767-b4be59461137 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.601652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 243/473] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:16:27 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:27.601652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f49f2c-0867-47ba-882f-83a9397490be None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:27.601938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 231/474] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:27.601938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb73a-fd61-4146-80c3-8f1e3136b742 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.601938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb73a-fd61-4146-80c3-8f1e3136b742 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.601938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0eb73a-fd61-4146-80c3-8f1e3136b742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.622302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ea0eb73a-fd61-4146-80c3-8f1e3136b742 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:27.623518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ea0eb73a-fd61-4146-80c3-8f1e3136b742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:27.655422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:27.676815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:27.708367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 232/475] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:27.709318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb73a-fd61-4146-80c3-8f1e3136b742 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:27.722797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f49f2c-0867-47ba-882f-83a9397490be None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.786912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38d9da-fd06-4282-86ea-eaf0455ff157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.787671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38d9da-fd06-4282-86ea-eaf0455ff157 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.788021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38d9da-fd06-4282-86ea-eaf0455ff157 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.788472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38d9da-fd06-4282-86ea-eaf0455ff157 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.791410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38d9da-fd06-4282-86ea-eaf0455ff157 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.791410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38d9da-fd06-4282-86ea-eaf0455ff157 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:27.870948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0eb73a-fd61-4146-80c3-8f1e3136b742 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:27.871581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 244/476] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:16:27 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:27.923118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ee436-d327-4fb8-a000-16b73ac51e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:27.923800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ee436-d327-4fb8-a000-16b73ac51e69 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:27.924188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ee436-d327-4fb8-a000-16b73ac51e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:27.924472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ee436-d327-4fb8-a000-16b73ac51e69 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:27.925182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ee436-d327-4fb8-a000-16b73ac51e69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:27.926726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ee436-d327-4fb8-a000-16b73ac51e69 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:28.008678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38d9da-fd06-4282-86ea-eaf0455ff157 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:28.043676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 233/477] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:16:27 2022] POST /identity/v3/users => generated 249 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:28.132349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:28.136179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38d9da-fd06-4282-86ea-eaf0455ff157 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:28.175568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:28.176956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:28.177250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:28.177531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:28.178305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:28.179732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:28.230006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.sql.core [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 16:16:28.230006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 16:16:28.230006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [parameters: {'id': 'f1a7af705c864f1d8fb768483c09af68', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 16:16:28.230006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81508) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application result.read() Aug 23 16:16:28.247379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:16:28.248298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application yield resource Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise self.value Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application session.commit() Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:16:28.249231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:16:28.250161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:16:28.251063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application result.read() Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:16:28.251910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [parameters: {'id': 'f1a7af705c864f1d8fb768483c09af68', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:28.253932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 16:16:28.262276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:28.263146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 245/478] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Aug 23 16:16:28 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:28.263214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ee436-d327-4fb8-a000-16b73ac51e69 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:28.295420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:28.368091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ee436-d327-4fb8-a000-16b73ac51e69 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:28.416599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15041da3-260f-4871-b933-34cdeedb8d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:28.418266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041da3-260f-4871-b933-34cdeedb8d40 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:28.419063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041da3-260f-4871-b933-34cdeedb8d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:28.419934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041da3-260f-4871-b933-34cdeedb8d40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:28.435521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15041da3-260f-4871-b933-34cdeedb8d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-15041da3-260f-4871-b933-34cdeedb8d40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:28.440739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:28.441626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:16:28.442442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:28.445036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 234/479] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:16:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:28.450492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:28.560467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dae8a-b56c-4d12-bff0-74d639087700 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:28.599626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad6b08-48b9-481a-a164-a3ddb47aa54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:28.600574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6b08-48b9-481a-a164-a3ddb47aa54c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:28.601053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6b08-48b9-481a-a164-a3ddb47aa54c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:28.601600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad6b08-48b9-481a-a164-a3ddb47aa54c None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:28.602500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad6b08-48b9-481a-a164-a3ddb47aa54c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:28.603539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad6b08-48b9-481a-a164-a3ddb47aa54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:28.605135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad6b08-48b9-481a-a164-a3ddb47aa54c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:28.617102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 246/480] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:29.420763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1a413-198f-47a1-8ac5-6f997c695df4 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:29.421295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1a413-198f-47a1-8ac5-6f997c695df4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:29.421295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1a413-198f-47a1-8ac5-6f997c695df4 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:29.422940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 235/481] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:29.428282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34c64-5fb8-40cf-9a0c-e1591094885c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:29.428714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34c64-5fb8-40cf-9a0c-e1591094885c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:29.428886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34c64-5fb8-40cf-9a0c-e1591094885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:29.454639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-dcc34c64-5fb8-40cf-9a0c-e1591094885c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:29.455858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dcc34c64-5fb8-40cf-9a0c-e1591094885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:29.491520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:29.553328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 247/482] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:29.916650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1ea4a-3981-46b9-b835-dda399978a54 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:29.916932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1ea4a-3981-46b9-b835-dda399978a54 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:29.917207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1ea4a-3981-46b9-b835-dda399978a54 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:29.918832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 236/483] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:29.924134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ce033-57d1-4b7f-b209-d7f757d37018 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:29.924424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ce033-57d1-4b7f-b209-d7f757d37018 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:29.924695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ce033-57d1-4b7f-b209-d7f757d37018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:29.943648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1ea4a-3981-46b9-b835-dda399978a54 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:29.961296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2f6ce033-57d1-4b7f-b209-d7f757d37018 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:29.963072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2f6ce033-57d1-4b7f-b209-d7f757d37018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:30.097145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 248/484] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:30.119248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:30.129056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1ea4a-3981-46b9-b835-dda399978a54 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:30.171797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec857-7a2e-4f2b-a64c-cbc63f193c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:30.172342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec857-7a2e-4f2b-a64c-cbc63f193c04 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.172620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec857-7a2e-4f2b-a64c-cbc63f193c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.172890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eec857-7a2e-4f2b-a64c-cbc63f193c04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.190688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eec857-7a2e-4f2b-a64c-cbc63f193c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f7eec857-7a2e-4f2b-a64c-cbc63f193c04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:30.195409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:30.196292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:30.197690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 237/485] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:30.203144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ce033-57d1-4b7f-b209-d7f757d37018 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:30.305700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:30.322921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ce033-57d1-4b7f-b209-d7f757d37018 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:30.365368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a815-6196-4e6b-88eb-156395cfc5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:30.366007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a815-6196-4e6b-88eb-156395cfc5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.366284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a815-6196-4e6b-88eb-156395cfc5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.366555 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a815-6196-4e6b-88eb-156395cfc5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.367221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a815-6196-4e6b-88eb-156395cfc5d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:30.367522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a815-6196-4e6b-88eb-156395cfc5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:30.369433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a815-6196-4e6b-88eb-156395cfc5d2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:30.378268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 249/486] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:30.383766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec857-7a2e-4f2b-a64c-cbc63f193c04 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:30.435283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455a9e-fdd2-444a-b4fa-ba4fb7b92670 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.435925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455a9e-fdd2-444a-b4fa-ba4fb7b92670 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.435925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455a9e-fdd2-444a-b4fa-ba4fb7b92670 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.437174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 250/487] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:30.463457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40778fe7-0eec-44db-babd-0dc035a3dd56 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.463759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40778fe7-0eec-44db-babd-0dc035a3dd56 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.463994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40778fe7-0eec-44db-babd-0dc035a3dd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.490183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-40778fe7-0eec-44db-babd-0dc035a3dd56 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:30.492455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-40778fe7-0eec-44db-babd-0dc035a3dd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:30.556628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eec857-7a2e-4f2b-a64c-cbc63f193c04 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:30.581360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 251/488] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:30.582249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40778fe7-0eec-44db-babd-0dc035a3dd56 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:30.592405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818074b-b95d-47eb-8353-8757653de01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:30.593258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818074b-b95d-47eb-8353-8757653de01b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.593715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818074b-b95d-47eb-8353-8757653de01b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.594156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818074b-b95d-47eb-8353-8757653de01b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.607544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818074b-b95d-47eb-8353-8757653de01b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:30.609971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818074b-b95d-47eb-8353-8757653de01b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-7818074b-b95d-47eb-8353-8757653de01b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:30.628893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:30.630063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:30.631124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:30.631124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:30.631124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:30.632767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 238/489] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:30.634699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea77db3-cd74-458e-a9f0-f397934ede91 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.635127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea77db3-cd74-458e-a9f0-f397934ede91 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.635541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea77db3-cd74-458e-a9f0-f397934ede91 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.637684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 239/490] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:30.638532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea77db3-cd74-458e-a9f0-f397934ede91 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:30.653958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:30.680689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:30.711465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40778fe7-0eec-44db-babd-0dc035a3dd56 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:30.756169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84614868-f4f7-4c8e-a377-5e7e8b8668ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:30.756803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84614868-f4f7-4c8e-a377-5e7e8b8668ab None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.757280 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84614868-f4f7-4c8e-a377-5e7e8b8668ab None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.757733 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84614868-f4f7-4c8e-a377-5e7e8b8668ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.758309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea77db3-cd74-458e-a9f0-f397934ede91 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:30.770537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84614868-f4f7-4c8e-a377-5e7e8b8668ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-84614868-f4f7-4c8e-a377-5e7e8b8668ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:30.777031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:30.777996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:30.778799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:30.781751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 252/491] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:30.783289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58884dc-09fa-4871-9a5c-f41575fc14c1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.784557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58884dc-09fa-4871-9a5c-f41575fc14c1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.785181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58884dc-09fa-4871-9a5c-f41575fc14c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.805986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e58884dc-09fa-4871-9a5c-f41575fc14c1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:30.807491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e58884dc-09fa-4871-9a5c-f41575fc14c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:30.808410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:30.809019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:30.809299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:30.809572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:30.810261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:30.810559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:30.812927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:30.828203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 240/492] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:30.829125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:30.893938 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 253/493] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:30.895108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58884dc-09fa-4871-9a5c-f41575fc14c1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:30.913569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:30.958204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267cea9-7c94-4265-b368-5f07e5b5d094 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:30.981946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.006326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.007219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.007497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.007768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.008548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:31.008854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.010974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:31.023411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58884dc-09fa-4871-9a5c-f41575fc14c1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.025782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 241/494] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:31.029892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.073534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.074209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.074488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.074761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.085646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.087426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:31.104294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:31.105225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:31.106397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:31.109759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 254/495] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:16:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:31.111154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.148930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ae495-9a89-4c73-a3e6-75758571e00b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.178737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.187344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415b81-b2f9-492a-8761-20732745e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.187975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415b81-b2f9-492a-8761-20732745e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.188255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415b81-b2f9-492a-8761-20732745e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.188775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80415b81-b2f9-492a-8761-20732745e0c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.199406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80415b81-b2f9-492a-8761-20732745e0c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-80415b81-b2f9-492a-8761-20732745e0c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:31.204026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:31.204899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 242/496] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:31.210102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415b81-b2f9-492a-8761-20732745e0c1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.234561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f064-ee57-4487-a908-b80eb46afa6e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.261112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.269016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.269659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.269941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.270484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.281683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.283148 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:31.297747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:31.298654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:31.304579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:31.304579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:31.304579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:31.304579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 255/497] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:31.304579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.314050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80415b81-b2f9-492a-8761-20732745e0c1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.347949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.348545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.348821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.349095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.349853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:31.350157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.351620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:31.388164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 243/498] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:31.388979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.402710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b9157-616c-4a7b-b6b9-0a721aae1586 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.433363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.434717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26f1b-60b7-4ff1-8c96-c648f838b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.435341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26f1b-60b7-4ff1-8c96-c648f838b2da None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.435890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26f1b-60b7-4ff1-8c96-c648f838b2da None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.435890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26f1b-60b7-4ff1-8c96-c648f838b2da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.445666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd26f1b-60b7-4ff1-8c96-c648f838b2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-6dd26f1b-60b7-4ff1-8c96-c648f838b2da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:31.451269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:31.452210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:31.453191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 256/499] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:31.454079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c727d-95a7-409c-8a7b-60950fb2b5da None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.454155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c727d-95a7-409c-8a7b-60950fb2b5da None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.454543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c727d-95a7-409c-8a7b-60950fb2b5da None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.456692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 257/500] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:31.456692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c727d-95a7-409c-8a7b-60950fb2b5da None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.486084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7891033-cfce-403e-af8c-5ad75c8708ea None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.496917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.519944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.520541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.520818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.521088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.521769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:31.522067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.523432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:31.532500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 244/501] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:31.533371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.558569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c727d-95a7-409c-8a7b-60950fb2b5da None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.591789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.592387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.592668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.592941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.593580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:31.593910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.595286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:31.612656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 258/502] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:31.613444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.633712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8d87-fb94-43a6-9613-7bbcec753aa2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.643290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.667562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb05f-d86e-4bcc-bffd-7fd9a086d837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.668200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb05f-d86e-4bcc-bffd-7fd9a086d837 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.668701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb05f-d86e-4bcc-bffd-7fd9a086d837 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.669262 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb05f-d86e-4bcc-bffd-7fd9a086d837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.707955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.711414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8640a-3de2-4010-8413-ffc89dba3699 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.735985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cb05f-d86e-4bcc-bffd-7fd9a086d837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.737792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cb05f-d86e-4bcc-bffd-7fd9a086d837 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:31.745686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d937bb-914a-48d6-b668-a9a7fbadfeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.746282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d937bb-914a-48d6-b668-a9a7fbadfeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.746566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d937bb-914a-48d6-b668-a9a7fbadfeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.746837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d937bb-914a-48d6-b668-a9a7fbadfeb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.747508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d937bb-914a-48d6-b668-a9a7fbadfeb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:31.747805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d937bb-914a-48d6-b668-a9a7fbadfeb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.749176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d937bb-914a-48d6-b668-a9a7fbadfeb4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:31.756888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 259/503] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:31.758051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5346-961e-449b-b43a-02e5acf4d98f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.758336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5346-961e-449b-b43a-02e5acf4d98f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.758610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af5346-961e-449b-b43a-02e5acf4d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.775863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e6af5346-961e-449b-b43a-02e5acf4d98f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:31.777064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e6af5346-961e-449b-b43a-02e5acf4d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:31.836382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 245/504] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:31.839427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb05f-d86e-4bcc-bffd-7fd9a086d837 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.844547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 260/505] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:31.845415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af5346-961e-449b-b43a-02e5acf4d98f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:31.851508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.949345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb05f-d86e-4bcc-bffd-7fd9a086d837 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.956918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:31.966763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af5346-961e-449b-b43a-02e5acf4d98f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:31.984208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:31.984837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:31.985117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:31.985387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:31.997437 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:31.998877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.002942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.003562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.003840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.004109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.012324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.013774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:32.014154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:32.015045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:32.015913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:32.015913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:32.015913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:32.015913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 246/506] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:32.016129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:32.031501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:32.032513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:16:32.033662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:32.035153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 261/507] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:32.035800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.086996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.130169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d19bfb-1388-441d-bc3f-528ad0275012 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.147497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a53523-4a29-407a-b1e8-2225bee0708c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.163481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.164102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.164379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.164650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.175546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.176994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.180490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.181693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.181970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.182233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:32.191269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:32.196908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:32.198028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:32.198028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:32.198028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:32.198028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 247/508] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:32.198295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.198377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.198451 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:32.210835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:32.211889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:32.212761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:32.212761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:32.212761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:32.212761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 262/509] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:32.212761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.215361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.295735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd78b65-fd05-4de8-9884-018931f5fd3b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.308440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.311517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedfa67-4281-4ad9-b0a8-67f210ce3464 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.328426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.329018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.329300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.329570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.330233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:32.330534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.331889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.343757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 248/510] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:32.344719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.347858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.348467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.348752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.349026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.349812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:32.350124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.351581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.388932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 263/511] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:32.389799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.443456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a14c7-1ba2-46a7-812b-bc506446f679 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.452096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.478847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.479473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.479753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.480023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.490190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.491629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.494920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda321d0-e691-4f03-ae35-2319f211ed98 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:32.505844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:32.506761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:32.507600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:32.507600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:32.507600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:32.507600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 249/512] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:32.507812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.529511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.530159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.530436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.530703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.531370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:32.531670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.532766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.533049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.545192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 264/513] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:32.546055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.608411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb26c-043b-44f0-93a1-52b08a915d4a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.642162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.642794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.642962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e34d39-08b0-454d-a75d-15772ad7f078 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.643070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.643291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.643932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:32.644243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.645654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.657192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 250/514] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:32.658018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.668910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.683018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.683643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.683928 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.684198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.691155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.692617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:32.704504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:32.705420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 265/515] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:32.711258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.742420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.757926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73740-1836-45d4-a8ca-03dbbcf25dae None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.792590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8f69c-f5c1-4b8c-91bc-70e8a8394e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.793183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8f69c-f5c1-4b8c-91bc-70e8a8394e60 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.793486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8f69c-f5c1-4b8c-91bc-70e8a8394e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.793785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8f69c-f5c1-4b8c-91bc-70e8a8394e60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.803802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be843d-db78-437d-b0af-91c9b952000f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.836491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.837010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.842082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.842082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.842082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:32.842082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.842082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.851848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 266/516] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:32.852545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.863942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8f69c-f5c1-4b8c-91bc-70e8a8394e60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.865449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a8f69c-f5c1-4b8c-91bc-70e8a8394e60 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:32.892409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.946139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:32.950976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2dc18-d323-47e2-a8d9-d2ecc610ab34 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:32.966721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 251/517] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:32.966721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8f69c-f5c1-4b8c-91bc-70e8a8394e60 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:32.985912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:32.986539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:32.987076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:32.987351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:32.994742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:32.996223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:33.007350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:33.008448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 267/518] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:33.010059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.065187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8f69c-f5c1-4b8c-91bc-70e8a8394e60 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.098727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664543-0247-44af-8461-260e8899e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.099348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664543-0247-44af-8461-260e8899e468 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.099625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664543-0247-44af-8461-260e8899e468 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.099893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16664543-0247-44af-8461-260e8899e468 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.107339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664543-0247-44af-8461-260e8899e468 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.108792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16664543-0247-44af-8461-260e8899e468 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.110159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:33.113267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b26b7-ad2c-49a1-b71f-0935693a04c4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-16664543-0247-44af-8461-260e8899e468 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:33.120464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:33.121290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:33.122405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 252/519] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:33.122886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664543-0247-44af-8461-260e8899e468 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.151532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.152131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.152411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.152678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.153401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:33.153749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.155174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.167438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:33.172947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 268/520] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:33.178372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.220834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16664543-0247-44af-8461-260e8899e468 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.254420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a8f10-6f1a-4923-a9ae-5ceb5207087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.255012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a8f10-6f1a-4923-a9ae-5ceb5207087a None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.255291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a8f10-6f1a-4923-a9ae-5ceb5207087a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.255562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a8f10-6f1a-4923-a9ae-5ceb5207087a None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.256199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a8f10-6f1a-4923-a9ae-5ceb5207087a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.257649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a8f10-6f1a-4923-a9ae-5ceb5207087a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.274847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c29e8-d201-47d5-b1b8-a7ff78b40dc8 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.307587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.308286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.308519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.308794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.318815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.319938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 253/521] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:16:33 2022] POST /identity/v3/users => generated 247 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:33.320301 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.320745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a8f10-6f1a-4923-a9ae-5ceb5207087a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:33.337357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:33.338390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:33.339349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:33.339349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:33.339349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:33.339349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 269/522] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:33.339586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.355457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:33.440479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:33.443281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a8f10-6f1a-4923-a9ae-5ceb5207087a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.458654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78fdc-111f-4d9e-bd2e-e56131fc61e0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.480645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.481969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.482240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.482505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.483237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:33.483536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.485100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.499031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.499622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.499907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.500235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.500898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:33.501208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.503329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.506575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 254/523] 10.222.0.61 () {56 vars in 1139 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:33.507248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.523973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 270/524] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:33.525203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.599492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:33.614668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4dc64-d682-4754-922b-dc11180560a9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.631465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4d1e-8d4b-40f5-8cc6-bdfd97f06102 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.654938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294132f5-465b-4e89-ba4b-e91c58ff4015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.655561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294132f5-465b-4e89-ba4b-e91c58ff4015 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.655833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294132f5-465b-4e89-ba4b-e91c58ff4015 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.656107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294132f5-465b-4e89-ba4b-e91c58ff4015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.668580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.669186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.669470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.669772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.670416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:33.670715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.672124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.684006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 271/525] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:33.685894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:33.687597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.730177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294132f5-465b-4e89-ba4b-e91c58ff4015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.732063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294132f5-465b-4e89-ba4b-e91c58ff4015 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.794850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375447bf-c7b6-4ae5-b02c-2683aae96767 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.824766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:33.830713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fc140-ed6e-47ff-a45f-4fe1bd6eb755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.831321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fc140-ed6e-47ff-a45f-4fe1bd6eb755 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.831600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fc140-ed6e-47ff-a45f-4fe1bd6eb755 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.831870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fc140-ed6e-47ff-a45f-4fe1bd6eb755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.838295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 255/526] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:33.838295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294132f5-465b-4e89-ba4b-e91c58ff4015 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:33.897284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:33.905804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fc140-ed6e-47ff-a45f-4fe1bd6eb755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.909753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fc140-ed6e-47ff-a45f-4fe1bd6eb755 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.942418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294132f5-465b-4e89-ba4b-e91c58ff4015 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:33.977101 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:33.977732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:33.978053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:33.978329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:33.979056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=33ac116b19864bd694ca089dd5f7e010) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:33.979364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:33.980795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:33.993984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 256/527] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/role_assignments?user.id=33ac116b19864bd694ca089dd5f7e010&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:33.993984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.019919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 272/528] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:34.020913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fc140-ed6e-47ff-a45f-4fe1bd6eb755 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.070500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:34.125922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30e6ca-da4b-4fa8-9f32-bba449db5034 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.152855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:34.165098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fc140-ed6e-47ff-a45f-4fe1bd6eb755 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.166102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.166741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.167153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.167387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.174986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.176539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:34.189887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:34.190951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:34.191791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:34.191791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:34.191791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:34.191791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:34.191791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:34.191791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:34.191791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:34.191791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:34.195911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 257/529] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:34.197249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.203975 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.204618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.204903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.205184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.216331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.218082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:34.233941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:34.234894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:34.235765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:34.235765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:34.235765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:34.235765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 273/530] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:34.236607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.303136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc42f0-0ce2-46cb-ae82-9358c1cce11b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.338063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:34.340496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.341189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.341474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.341837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.349995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3846d0-4eca-41c9-aa5e-ba1856537e21 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.353586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.355096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:34.371110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:34.373259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:34.375393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:34.375393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:34.375393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:34.381659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 258/531] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:34.381659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.387540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.388281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.389062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.389539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.390597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:34.391462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.393000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.405857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 274/532] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:34.406907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.456421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:34.519509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5d2b1-f5dc-4e26-bd11-44cfb384cce0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.546228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066e3f4-8ef8-4bb3-8deb-4a715db16ef3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.555653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.556237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.556610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.556977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.557774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:34.558344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.559635 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.572701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 259/533] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:34.573732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.588915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.589781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.590131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.590510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.591250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:34.591703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.593161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.609733 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 275/534] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:34.609733 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.610597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:34.683878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:34.691271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddac21-8d33-4c04-a474-d3b9eb739cf2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.729081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.729826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.730415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.730761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.731680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=f8070d1891844da59196d00ebbdff832) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:34.732073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.733635 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.741949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20c9be-7eb6-40f8-ba55-86762c298090 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.746104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 260/535] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/role_assignments?user.id=f8070d1891844da59196d00ebbdff832&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:34.747216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.788186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.789231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.791240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.791745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.810917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.812415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:34.840355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:34.841298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:34.842220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:34.842220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:34.842220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:34.842220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:34.842220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:34.842220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:34.842220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:34.842220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:34.849811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 276/536] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:34.855850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:34.888953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012c682-1f03-4326-9fe1-6272ef785f89 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:34.947904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:34.948897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:34.949374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:34.949874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:34.967578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:34.969385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:34.988628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:34.989507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:34.990433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:34.990433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:34.990433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:34.990433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:34.990433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:34.990433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:34.990433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:34.990433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:34.994339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:35.005671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 261/537] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:35.019422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:35.052453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:35.072556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347f011-0930-4a50-8776-9e5abf416ed8 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:35.138138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:35.138750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:35.139029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:35.139298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:35.139997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:35.142696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:35.144162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:35.168512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 277/538] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:35.175867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:35.193843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3da440-b480-4007-a990-74be9d67c921 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:35.237414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:35.238405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:35.239074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:35.240941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:35.241882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:35.243224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:35.245455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:35.267722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 262/539] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:35.277520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:35.351902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144820-540a-41b7-8497-dd35d12fc69f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:35.369471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:35.379644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:35.394793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a3333-6a68-4d0c-ab10-8ca11fa8a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:35.395397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3333-6a68-4d0c-ab10-8ca11fa8a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:35.395687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3333-6a68-4d0c-ab10-8ca11fa8a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:35.395961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a3333-6a68-4d0c-ab10-8ca11fa8a1e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:35.396690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a3333-6a68-4d0c-ab10-8ca11fa8a1e0 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=1a81f47e4b004716bf54175c55606d70) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:35.396997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a3333-6a68-4d0c-ab10-8ca11fa8a1e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:35.398507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a3333-6a68-4d0c-ab10-8ca11fa8a1e0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:35.400916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dacc6f-d1bd-49c0-9ae2-c675bdc3331f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:35.406018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 278/540] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:35 2022] GET /identity/v3/role_assignments?user.id=1a81f47e4b004716bf54175c55606d70&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:35.407333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dabff-4a17-400c-8ac8-57c4fae56128 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:35.407625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dabff-4a17-400c-8ac8-57c4fae56128 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:35.407906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dabff-4a17-400c-8ac8-57c4fae56128 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:35.409347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 279/541] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:35.419280 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9a1b9-0791-4069-b711-322aee90785c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:35.419668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9a1b9-0791-4069-b711-322aee90785c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:35.419836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9a1b9-0791-4069-b711-322aee90785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:35.446004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:35.447041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:35.447537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:35.448038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:35.449062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=3d5b15e9f0414836b3611a8ff6085b80) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:35.449574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:35.451282 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:35.458381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 263/542] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:35 2022] GET /identity/v3/role_assignments?user.id=3d5b15e9f0414836b3611a8ff6085b80&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:35.461686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f8e9a1b9-0791-4069-b711-322aee90785c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:35.461686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f8e9a1b9-0791-4069-b711-322aee90785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:35.562332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 280/543] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:35.855994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:35.976515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f36910-181c-42db-9484-fa39b3c536e3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:36.019265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692f18c-a2ea-46a1-9c58-3de60d51ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:36.019898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692f18c-a2ea-46a1-9c58-3de60d51ec45 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.020173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692f18c-a2ea-46a1-9c58-3de60d51ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.020443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692f18c-a2ea-46a1-9c58-3de60d51ec45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.030812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692f18c-a2ea-46a1-9c58-3de60d51ec45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8692f18c-a2ea-46a1-9c58-3de60d51ec45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:36.035980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:36.036835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:36.037709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 264/544] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:36.043463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9a1b9-0791-4069-b711-322aee90785c None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:36.169023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9a1b9-0791-4069-b711-322aee90785c None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:36.187314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:36.214314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a2c5b-a326-4eff-a65e-db7d42582cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:36.214944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a2c5b-a326-4eff-a65e-db7d42582cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.215230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a2c5b-a326-4eff-a65e-db7d42582cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.215511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a2c5b-a326-4eff-a65e-db7d42582cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.216196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a2c5b-a326-4eff-a65e-db7d42582cd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:36.216506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a2c5b-a326-4eff-a65e-db7d42582cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:36.217926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a2c5b-a326-4eff-a65e-db7d42582cd8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:36.226497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 281/545] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:36.232173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692f18c-a2ea-46a1-9c58-3de60d51ec45 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:36.237149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:36.291415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f7b2-7ffc-4f63-9fea-367eed6d1f77 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.292043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f7b2-7ffc-4f63-9fea-367eed6d1f77 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.292516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f7b2-7ffc-4f63-9fea-367eed6d1f77 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.294334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 282/546] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:36.300422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7c476-1f46-4fb7-8a55-f16e1f55b29f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.300952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7c476-1f46-4fb7-8a55-f16e1f55b29f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.301422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7c476-1f46-4fb7-8a55-f16e1f55b29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.322331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-55e7c476-1f46-4fb7-8a55-f16e1f55b29f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:36.324140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-55e7c476-1f46-4fb7-8a55-f16e1f55b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:36.414132 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692f18c-a2ea-46a1-9c58-3de60d51ec45 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:36.453794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:36.454752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.455229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.455696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.463817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 283/547] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:36.471989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:36.473718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:36.497571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:36.498517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:36.499350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:36.499350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:36.499350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:36.509157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7c476-1f46-4fb7-8a55-f16e1f55b29f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:36.510166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 265/548] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:36.626900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7c476-1f46-4fb7-8a55-f16e1f55b29f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:36.636267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:36.665038 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:36.666181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.666460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.666732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.667379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:36.667677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:36.669319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:36.682486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 284/549] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:36.687526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:36.755735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:36.802155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054c262-a07f-44ff-950c-8edd9fe7f125 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:36.838494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:36.843767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:36.843767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:36.843767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:36.849272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:36.851092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:36.864994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:36.866345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:16:36.867762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:36.870983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 266/550] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:36.876438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:36.886619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.000731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9266b-bcb4-4222-b075-3250e9fd064d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:37.006867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e05fcf-0c4f-47b6-bd81-dc80a1b3c69a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:37.031207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:37.043069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a95bf-e2ef-4e0b-89b8-e0a542965554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:37.043990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a95bf-e2ef-4e0b-89b8-e0a542965554 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.044435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a95bf-e2ef-4e0b-89b8-e0a542965554 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.044875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a95bf-e2ef-4e0b-89b8-e0a542965554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.060209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a95bf-e2ef-4e0b-89b8-e0a542965554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ec3a95bf-e2ef-4e0b-89b8-e0a542965554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:37.065631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:37.066723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:37.067557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:37.070614 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 267/551] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:37.076499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a95bf-e2ef-4e0b-89b8-e0a542965554 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.080607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:37.082200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.082615 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.088114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.089029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:37.089506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:37.091123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:37.122874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 285/552] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Aug 23 16:16:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:37.131094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.173952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:37.226271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a95bf-e2ef-4e0b-89b8-e0a542965554 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:37.265742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83977cee-31cd-471c-8cb6-733d3a934716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:37.266272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83977cee-31cd-471c-8cb6-733d3a934716 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.266548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83977cee-31cd-471c-8cb6-733d3a934716 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.266816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83977cee-31cd-471c-8cb6-733d3a934716 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.267479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83977cee-31cd-471c-8cb6-733d3a934716 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:37.267779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83977cee-31cd-471c-8cb6-733d3a934716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:37.269152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83977cee-31cd-471c-8cb6-733d3a934716 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:37.274011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a67f1-0bf4-433f-b584-689279f655cb None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:37.278616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 268/553] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:37.280005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6fccc-c9cc-4443-aa6d-1775e247c015 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.280314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6fccc-c9cc-4443-aa6d-1775e247c015 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.280584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6fccc-c9cc-4443-aa6d-1775e247c015 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.285927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 269/554] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:37.286723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6fccc-c9cc-4443-aa6d-1775e247c015 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.319394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faa684-e04a-464a-8c56-5087aca78cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:37.320413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa684-e04a-464a-8c56-5087aca78cbb None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.320968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa684-e04a-464a-8c56-5087aca78cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.321320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faa684-e04a-464a-8c56-5087aca78cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.327006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:37.399392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faa684-e04a-464a-8c56-5087aca78cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:37.401600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faa684-e04a-464a-8c56-5087aca78cbb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:37.423488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6fccc-c9cc-4443-aa6d-1775e247c015 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:37.430388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:37.473670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:37.475727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.476242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.476715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.488381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:37.490304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:37.506295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:37.507236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:37.508190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:37.508190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:37.508190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:37.515063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 286/556] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:37.515063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0669a-156d-4b40-93ae-5936d563206a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.515063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0669a-156d-4b40-93ae-5936d563206a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.515063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0669a-156d-4b40-93ae-5936d563206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.515722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 270/556] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:37.516816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.532030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-17b0669a-156d-4b40-93ae-5936d563206a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:37.533432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-17b0669a-156d-4b40-93ae-5936d563206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:37.613758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 287/557] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:37.614975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:37.615951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0669a-156d-4b40-93ae-5936d563206a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.625639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6df05-fb0a-4b9b-b4d5-9ea21f291323 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:37.662589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88a7c7-026e-4ed7-a2c2-f38fc83ab06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:37.663509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a7c7-026e-4ed7-a2c2-f38fc83ab06d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.663988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a7c7-026e-4ed7-a2c2-f38fc83ab06d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.664433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88a7c7-026e-4ed7-a2c2-f38fc83ab06d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.675780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88a7c7-026e-4ed7-a2c2-f38fc83ab06d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:37.677774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88a7c7-026e-4ed7-a2c2-f38fc83ab06d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:37.724578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ad88a7c7-026e-4ed7-a2c2-f38fc83ab06d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:37.725479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:37.726900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:37.727826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:37.727826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:37.727826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:37.727826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 271/558] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:37.728055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601195-840c-4cd7-b118-37decaf1bd25 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.728549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601195-840c-4cd7-b118-37decaf1bd25 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.728549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b601195-840c-4cd7-b118-37decaf1bd25 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.733808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 272/559] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:37.734626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b601195-840c-4cd7-b118-37decaf1bd25 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.779469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0669a-156d-4b40-93ae-5936d563206a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:37.817912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d993d-ec7e-4397-b24a-9d2d06c544a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:37.818524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d993d-ec7e-4397-b24a-9d2d06c544a9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.818802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d993d-ec7e-4397-b24a-9d2d06c544a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.819077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d993d-ec7e-4397-b24a-9d2d06c544a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.819726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d993d-ec7e-4397-b24a-9d2d06c544a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:37.820027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d993d-ec7e-4397-b24a-9d2d06c544a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:37.821407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d993d-ec7e-4397-b24a-9d2d06c544a9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:37.834070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 288/560] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:37.835285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db192e-b1e2-4c2d-8b8c-20152730886b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.835572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db192e-b1e2-4c2d-8b8c-20152730886b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.835952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db192e-b1e2-4c2d-8b8c-20152730886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.854085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-68db192e-b1e2-4c2d-8b8c-20152730886b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:37.855276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-68db192e-b1e2-4c2d-8b8c-20152730886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:37.864439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b601195-840c-4cd7-b118-37decaf1bd25 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:37.903559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:37.904225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.904452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.904725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.905368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:37.905696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:37.907059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:37.915879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:37.919912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 273/561] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:37.920527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.931646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 289/562] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:37.933185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1313-8b61-4c0e-9d05-400652203c27 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:37.933472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1313-8b61-4c0e-9d05-400652203c27 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:37.933845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1313-8b61-4c0e-9d05-400652203c27 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:37.935223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 290/563] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:37.940086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1313-8b61-4c0e-9d05-400652203c27 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:37.991004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.043767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259e360-9f00-4032-bb7a-72adfce89ec7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.046013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1313-8b61-4c0e-9d05-400652203c27 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.080884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9e05c-1ae1-4efd-be67-8723002e7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.081516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e05c-1ae1-4efd-be67-8723002e7acd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.081837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e05c-1ae1-4efd-be67-8723002e7acd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.082112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9e05c-1ae1-4efd-be67-8723002e7acd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.083756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.084380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.084658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.085315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.090317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9e05c-1ae1-4efd-be67-8723002e7acd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:38.091788 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9e05c-1ae1-4efd-be67-8723002e7acd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:38.092012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:38.093465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d7e9e05c-1ae1-4efd-be67-8723002e7acd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:38.104727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:38.105709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:38.106771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:38.107313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:38.108118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:38.108998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:38.108998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:38.108998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:38.108998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:38.108998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:38.108998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:38.108998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:38.108998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:38.110928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 274/564] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:16:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:38.110928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095abfe-158a-457f-bc9c-32eb8b4da12b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.110928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095abfe-158a-457f-bc9c-32eb8b4da12b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.110928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095abfe-158a-457f-bc9c-32eb8b4da12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.111655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 291/565] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:38.113276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.127966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8095abfe-158a-457f-bc9c-32eb8b4da12b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:38.129167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8095abfe-158a-457f-bc9c-32eb8b4da12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:38.188802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.201946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 275/566] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:38.202984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095abfe-158a-457f-bc9c-32eb8b4da12b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.231057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77c65-cc41-4b5b-aedf-34d45e271e1d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.238265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.265790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada5a8e-7be1-4342-86c3-34f2b3be5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.266496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada5a8e-7be1-4342-86c3-34f2b3be5d8c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.266845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada5a8e-7be1-4342-86c3-34f2b3be5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.267190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada5a8e-7be1-4342-86c3-34f2b3be5d8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.277217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada5a8e-7be1-4342-86c3-34f2b3be5d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-1ada5a8e-7be1-4342-86c3-34f2b3be5d8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:38.281854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:38.282993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:38.284028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:38.287616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 292/567] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:38.288434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada5a8e-7be1-4342-86c3-34f2b3be5d8c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.311631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095abfe-158a-457f-bc9c-32eb8b4da12b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.347304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.347908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.348192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.348464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.349198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:38.349502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:38.350979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:38.369310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 276/568] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:38.373961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.398988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada5a8e-7be1-4342-86c3-34f2b3be5d8c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.427880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.432953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.433560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.433891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.434164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.434858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:38.435151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:38.436578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:38.448368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 293/569] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:38.449002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.479507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.492404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a2de5-8044-419e-83f3-c1c5a9070805 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.526109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7e9cd-5d84-4ad0-bc5f-cd7928012b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.526732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7e9cd-5d84-4ad0-bc5f-cd7928012b55 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.527008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7e9cd-5d84-4ad0-bc5f-cd7928012b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.527278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7e9cd-5d84-4ad0-bc5f-cd7928012b55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.537078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7e9cd-5d84-4ad0-bc5f-cd7928012b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-90f7e9cd-5d84-4ad0-bc5f-cd7928012b55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:38.542683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:38.543748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 277/570] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:38.544997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7e9cd-5d84-4ad0-bc5f-cd7928012b55 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.563670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e39e-e7b7-4774-a49a-055f9ba8a79f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.597419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.598048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.598323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.598593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.599251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:38.599549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:38.600912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:38.609047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 294/571] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:38.609844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.641868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7e9cd-5d84-4ad0-bc5f-cd7928012b55 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.651500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.676222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.677041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.677374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.677678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.688178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:38.689659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:38.696899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:38.703938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:38.705105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:38.706028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:38.706028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:38.706028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:38.706028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 278/572] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:38.706028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.713251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df192d-9864-45b4-9624-1462db1b9d6f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.747106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.747819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.747958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.748227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.748947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=8442dc046cb64619b62823b8bcc7cc4b) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:38.749251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:38.750702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:38.755914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 295/573] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/role_assignments?user.id=8442dc046cb64619b62823b8bcc7cc4b&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:38.756697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.814853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cb688-9709-4e13-9b1b-35bcc144bedd None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.851951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecab09-539e-4b0f-b50b-4127966bfd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.852601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecab09-539e-4b0f-b50b-4127966bfd5c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.853428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecab09-539e-4b0f-b50b-4127966bfd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.853731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecab09-539e-4b0f-b50b-4127966bfd5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.865416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecab09-539e-4b0f-b50b-4127966bfd5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:38.870974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3ae69-29da-4da3-81f5-1ac383a6ed3c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-bfecab09-539e-4b0f-b50b-4127966bfd5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:38.871413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:38.872328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:38.873192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 279/574] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:38.878136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecab09-539e-4b0f-b50b-4127966bfd5c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.903153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.916444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:38.917054 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:38.917329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:38.918305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:38.918305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:38.918584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:38.920008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:38.928325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 296/575] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:38.929147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:38.948005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:38.992096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecab09-539e-4b0f-b50b-4127966bfd5c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.032286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.032927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.033207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.033481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.035718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e967-5aa8-4ef2-a1eb-d08f1df4e894 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.044652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.046130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:39.064915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:39.065917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:39.072248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:39.072248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:39.072248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:39.072248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 280/576] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:39.072248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.079120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.079706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.079985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.080255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.080898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:39.081194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.082610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.094331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 297/577] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:39.095094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.149274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:39.175075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:39.179637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b83e10-078c-4b20-bf78-704208bb20f1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.200889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e7224-f22e-4aeb-8bad-6696514f9d7c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.216988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.217598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.217945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.218210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.218885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:39.219185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.220567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.233210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 281/578] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:39.233210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.243929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.244652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.244996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.245337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.256707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.258206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:39.272181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:39.273116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:39.279294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:39.279294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:39.279294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:39.279294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 298/579] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:39.279294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.342042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078a7aa-d3d7-4712-af7a-091da9fa5cc1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.379170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.379783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.380048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.380334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.380955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:39.381252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.381550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb0f9f-8b6c-437c-a486-5ddb5d9cac9a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.382671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.384657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:39.395039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 282/580] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:39.395840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.411894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:39.422097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.423192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.423817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.424255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.433360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.435793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:39.450250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:39.451298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:39.452472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:39.452472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:39.452472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:39.452472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:39.452472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:39.452472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:39.452472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:39.452472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:39.458283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 299/581] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:39.458283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.508552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2bceb-d531-4b2a-a989-243caa66a719 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.546794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.547421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.547706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.547978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.557998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.558996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925fb07-46c4-465d-a89c-2e8e0e438e72 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.559427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:39.574989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:39.576159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:39.577057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:39.577057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:39.577057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:39.577057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 283/582] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:39.577290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.601791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.602320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.602597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.602916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.603557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:39.603857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.605223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.617665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 300/583] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:39.618513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.628597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:39.671937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:39.685118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054afe3-1aea-44a6-83f9-7a9cdcfe1442 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.719973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.720599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.720882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.721149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.727613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe8d51-cc59-41d6-935f-fcbb48872406 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.729699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.731163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:39.742555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:39.744283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 284/584] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:39.746256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.770150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.771325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.771775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.772206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.773064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:39.773424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.774966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.792988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 301/585] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:39.792988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.856919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b75ae1-abe4-40cd-9b9f-a65ee1d03a23 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.901733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:39.927712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e864d0-4746-43db-b914-75a5ed5306bd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:39.930211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.931037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.931394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.932043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.933038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:39.933828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.935206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.935700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:39.947161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 285/586] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:39.947961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:39.966684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:39.967673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:39.968197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:39.968655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:39.976340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:39.977865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:39.991400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:39.992377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:16:39.993329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:39.994402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 302/587] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:39.994629 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.062998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85897df-9288-4a19-80b2-ddf2169caaec None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.097932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.098535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.098814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.099145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.099812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:40.100114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.101534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.102640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adceee5-a517-4b51-a0eb-ce9627dd2f9e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.121137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 286/588] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Aug 23 16:16:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:40.126280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.140876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31634f-947f-46fc-bf9f-1fe22fc14cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.141683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31634f-947f-46fc-bf9f-1fe22fc14cfb None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.142035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31634f-947f-46fc-bf9f-1fe22fc14cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.142308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31634f-947f-46fc-bf9f-1fe22fc14cfb None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/33ac116b19864bd694ca089dd5f7e010/roles/509e1b745fb24a048d7ff490dc477940` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.153240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:40.157515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31634f-947f-46fc-bf9f-1fe22fc14cfb None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=33ac116b19864bd694ca089dd5f7e010, role_id=509e1b745fb24a048d7ff490dc477940)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.159019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31634f-947f-46fc-bf9f-1fe22fc14cfb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.228715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b67896-027b-4f97-9a13-fab22f9e6caf None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.247607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 303/589] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:16:39 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/33ac116b19864bd694ca089dd5f7e010/roles/509e1b745fb24a048d7ff490dc477940 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:40.248832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31634f-947f-46fc-bf9f-1fe22fc14cfb None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.277952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.278613 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.278897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.279260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.282286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:40.289408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.291709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:40.304629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:40.305770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 287/590] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:40.311771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.387815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31634f-947f-46fc-bf9f-1fe22fc14cfb None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.407209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:40.425668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ef7fd-cd24-4375-9e34-e039b17870a9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.435581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.436584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.437046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.437492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.438434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:40.438834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.440354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.460753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 304/591] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:40.461930 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.467327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.468184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.468631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.469108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.481336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.483288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:40.499906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:40.501102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:40.502257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:40.502257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:40.502257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:40.504224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 288/592] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:40.505213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.564399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:40.595347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39408a2a-3aa8-4ddd-ba21-652573c98f3d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.643360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de30dc5-034a-4ce8-a071-60b0a6f4247d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.645514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.647240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.647674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.648121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.649011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:40.649469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.651612 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.674564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 305/593] 10.222.0.61 () {56 vars in 1139 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:40.675682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.684548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a341bd-48b4-4086-8076-1ec769ecc7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.685356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a341bd-48b4-4086-8076-1ec769ecc7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.685766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a341bd-48b4-4086-8076-1ec769ecc7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.686116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a341bd-48b4-4086-8076-1ec769ecc7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.689131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:40.697128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a341bd-48b4-4086-8076-1ec769ecc7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.698658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a341bd-48b4-4086-8076-1ec769ecc7c8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-87a341bd-48b4-4086-8076-1ec769ecc7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:40.713046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:40.714080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:40.714998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:40.714998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:40.714998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:40.714998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 289/594] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:40.716470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd3aa-c75d-4d57-8f6f-34574859b26f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.716470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd3aa-c75d-4d57-8f6f-34574859b26f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.716470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efd3aa-c75d-4d57-8f6f-34574859b26f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.717288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 290/595] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:40.717991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efd3aa-c75d-4d57-8f6f-34574859b26f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.791422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf2cbe-078f-475e-972e-ee01af6db383 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.821996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:40.827050 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.827688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.827973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.828252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.828961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:40.829269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.830715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.832319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efd3aa-c75d-4d57-8f6f-34574859b26f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.842773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 306/596] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:40.843694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:40.873509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1481e-88db-4537-a3d2-accb5c4c4a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:40.874192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1481e-88db-4537-a3d2-accb5c4c4a62 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.874480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1481e-88db-4537-a3d2-accb5c4c4a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.874754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1481e-88db-4537-a3d2-accb5c4c4a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.885371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1481e-88db-4537-a3d2-accb5c4c4a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:40.886901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1481e-88db-4537-a3d2-accb5c4c4a62 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-50c1481e-88db-4537-a3d2-accb5c4c4a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:40.901546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:40.902511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:40.903419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:40.903419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:40.903419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:40.903419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 291/597] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:40.903922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fabf0-6aa1-4e67-95b7-2c70bcaf098f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:40.904013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fabf0-6aa1-4e67-95b7-2c70bcaf098f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:40.904293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fabf0-6aa1-4e67-95b7-2c70bcaf098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:40.922051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2d8fabf0-6aa1-4e67-95b7-2c70bcaf098f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:40.923246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2d8fabf0-6aa1-4e67-95b7-2c70bcaf098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:40.956891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:40.963330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced91af-2b86-4dbf-bec8-b7c9759d6e94 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:40.990736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 292/598] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:40.991581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fabf0-6aa1-4e67-95b7-2c70bcaf098f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.008827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.009973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.010463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.010957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.011824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:41.012373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.014137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.031574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 307/599] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:41.032781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.091809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.102483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fabf0-6aa1-4e67-95b7-2c70bcaf098f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.138319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.138933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.139226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.139503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.145647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86acd3d-8804-45ec-880a-d4b8e5950afd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.146507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.147954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:41.159855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:41.160765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:41.161687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:41.161687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:41.161687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:41.161687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:41.161687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:41.161687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:41.161687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:41.161687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:41.165621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 293/600] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:41.166469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.188584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.189521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.190050 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.190547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.191506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:41.192105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.193695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.197874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.209492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 308/601] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:41.212840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.271957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f0697-37fc-4a68-8349-4f7a932a72cd None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.308638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.309272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.309556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.309861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.316881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.318421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.322205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c290105-86d7-48bf-8e49-cfc8034079a9 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:41.330770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:41.331673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:41.332565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 294/602] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:41.333925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.337831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.361823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.362679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.362961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.363234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.363927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:41.364231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.366185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.383568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 309/603] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:41.383568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.438018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.449643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db633b5-1219-4387-a5c0-b99a49522e78 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.486137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.486965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.487465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.487751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.492705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c575f2-ef28-4c30-8e03-e25d78ae9be8 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.494451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.495886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:41.506913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:41.507806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 295/604] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:41.508720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.535384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dca8f-5fc5-430a-9d9c-5d0b0929b04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.536013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dca8f-5fc5-430a-9d9c-5d0b0929b04e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.536296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dca8f-5fc5-430a-9d9c-5d0b0929b04e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.536573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dca8f-5fc5-430a-9d9c-5d0b0929b04e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.547834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dca8f-5fc5-430a-9d9c-5d0b0929b04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-ee4dca8f-5fc5-430a-9d9c-5d0b0929b04e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:41.552891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:41.554131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:41.554999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 310/605] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:41.555689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dca8f-5fc5-430a-9d9c-5d0b0929b04e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.586605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.624583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180027ed-313d-4cfc-92f6-d9a25bdb9946 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.658192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dca8f-5fc5-430a-9d9c-5d0b0929b04e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.661387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.662020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.662297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.662564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.663255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:41.663558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.664979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.682335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 296/606] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:41.682335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.694543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927103d-96cd-48c4-81de-581c0ad4db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.695141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927103d-96cd-48c4-81de-581c0ad4db28 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.695423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927103d-96cd-48c4-81de-581c0ad4db28 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.695704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927103d-96cd-48c4-81de-581c0ad4db28 None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/f8070d1891844da59196d00ebbdff832/roles/509e1b745fb24a048d7ff490dc477940` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.695858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.712037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927103d-96cd-48c4-81de-581c0ad4db28 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=f8070d1891844da59196d00ebbdff832, role_id=509e1b745fb24a048d7ff490dc477940)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.715219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927103d-96cd-48c4-81de-581c0ad4db28 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.767845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 311/607] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:16:41 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/f8070d1891844da59196d00ebbdff832/roles/509e1b745fb24a048d7ff490dc477940 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:41.768695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927103d-96cd-48c4-81de-581c0ad4db28 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.796217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94597905-5a5b-4c4b-80ee-6b0cd3573bf0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.842639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.843397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.843688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.848153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.848153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:41.848153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.848153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.867298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 297/608] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:41.867298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:41.886034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.909198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927103d-96cd-48c4-81de-581c0ad4db28 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:41.955593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:41.955593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:41.956674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:41.957110 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:41.959081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:41.959081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:41.960355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:41.967148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:41.973776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 312/609] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:41.973776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:42.010254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49927e0f-14c9-43e1-aaa6-13f320ff0bd8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:42.059140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3165c-aa12-4606-a21c-ca26e5482c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:42.059281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3165c-aa12-4606-a21c-ca26e5482c85 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:42.059497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3165c-aa12-4606-a21c-ca26e5482c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:42.059772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3165c-aa12-4606-a21c-ca26e5482c85 None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/1a81f47e4b004716bf54175c55606d70/roles/509e1b745fb24a048d7ff490dc477940` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:42.079350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3165c-aa12-4606-a21c-ca26e5482c85 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=1a81f47e4b004716bf54175c55606d70, role_id=509e1b745fb24a048d7ff490dc477940)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:42.081689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3165c-aa12-4606-a21c-ca26e5482c85 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:42.106281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e18efa-c126-45de-8223-ff214c52ab3e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:42.144364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7428d-5766-46d8-ac47-e7889237971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:42.145359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7428d-5766-46d8-ac47-e7889237971e None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:42.145867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7428d-5766-46d8-ac47-e7889237971e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:42.146323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7428d-5766-46d8-ac47-e7889237971e None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/3d5b15e9f0414836b3611a8ff6085b80/roles/509e1b745fb24a048d7ff490dc477940` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:42.166258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7428d-5766-46d8-ac47-e7889237971e None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=3d5b15e9f0414836b3611a8ff6085b80, role_id=509e1b745fb24a048d7ff490dc477940)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:42.168097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7428d-5766-46d8-ac47-e7889237971e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:42.170751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:42.172574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 298/610] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:16:41 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/1a81f47e4b004716bf54175c55606d70/roles/509e1b745fb24a048d7ff490dc477940 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:42.173657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3165c-aa12-4606-a21c-ca26e5482c85 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:42.269594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 313/611] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:16:41 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/3d5b15e9f0414836b3611a8ff6085b80/roles/509e1b745fb24a048d7ff490dc477940 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:42.272317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc401a-b43b-441c-8de8-fcb1427b63af None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:42.273190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc401a-b43b-441c-8de8-fcb1427b63af None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:42.273697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc401a-b43b-441c-8de8-fcb1427b63af None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:42.277325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 314/612] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:42.283059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afc4b-96eb-47ce-a2a6-76902787d449 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:42.283346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afc4b-96eb-47ce-a2a6-76902787d449 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:42.283621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afc4b-96eb-47ce-a2a6-76902787d449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:42.317646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-6d5afc4b-96eb-47ce-a2a6-76902787d449 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:42.318390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3165c-aa12-4606-a21c-ca26e5482c85 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:42.319815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6d5afc4b-96eb-47ce-a2a6-76902787d449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:42.346186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:42.365487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:42.366456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:42.366888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:42.367414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:42.382411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:42.385803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:42.405330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:42.406573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:42.407462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:42.407462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:42.407462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:42.409307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 299/613] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:42.415128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:42.426494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 315/614] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:42.529090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e124bc-7f46-409f-a524-7fbbf2b168dc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:42.564984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca307-0718-4325-9771-24436f449011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:42.565894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca307-0718-4325-9771-24436f449011 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:42.566326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca307-0718-4325-9771-24436f449011 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:42.566749 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca307-0718-4325-9771-24436f449011 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:42.567537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca307-0718-4325-9771-24436f449011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:42.568003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca307-0718-4325-9771-24436f449011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:42.569523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca307-0718-4325-9771-24436f449011 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:42.582454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 300/615] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:42.588009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5afc4b-96eb-47ce-a2a6-76902787d449 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:42.716449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5afc4b-96eb-47ce-a2a6-76902787d449 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:42.720102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca307-0718-4325-9771-24436f449011 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:42.740874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:42.756979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:42.757650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:42.758741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:42.758924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:42.760112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:42.769705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:42.773441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:42.789979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:42.791040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:16:42.792042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:42.795173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 316/616] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:42.800330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:42.850033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca307-0718-4325-9771-24436f449011 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:42.910979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4804-754a-4bb5-98ca-960c73a4bbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:42.911775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4804-754a-4bb5-98ca-960c73a4bbff None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:42.912160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4804-754a-4bb5-98ca-960c73a4bbff None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:42.912531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e4804-754a-4bb5-98ca-960c73a4bbff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:42.933030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e4804-754a-4bb5-98ca-960c73a4bbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-3a9e4804-754a-4bb5-98ca-960c73a4bbff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:42.941991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:42.943190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:42.944222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:42.946190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 301/617] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:42.952373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4804-754a-4bb5-98ca-960c73a4bbff None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:42.966241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961eb5-cdd4-47ab-9294-0a5422a1793f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:43.003982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:43.004831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:43.005281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:43.005784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:43.006656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:43.007105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:43.008686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:43.027702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 317/618] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Aug 23 16:16:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:43.033348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:43.080226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:43.090279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e4804-754a-4bb5-98ca-960c73a4bbff None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:43.110877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:43.150539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:43.151466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:43.151888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:43.152300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:43.153106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:43.153565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:43.155095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:43.163922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 302/619] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:43.170294 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:43.185135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74a764-33de-4550-b375-8541212dfc1a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:43.226891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:43.227800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:43.228261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:43.228677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:43.250209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:43.251883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:43.276812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:43.277992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:43.279124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:43.279124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:43.279124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:43.280797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 318/620] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:43.286404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:43.395210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca26e91-17e8-4c2a-b126-8b3125525730 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:43.445844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:43.456481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78bc2e-52c5-4452-abc4-43487c59b3c4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:43.464964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:43.465847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:43.466274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:43.466691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:43.486833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:43.489878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:43.515823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:43.517014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:43.518133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:43.518133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:43.518133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:43.520062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 303/621] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:43.524334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:43.525358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:43.525813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:43.526865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:43.527727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:43.528958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:43.531312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:43.532987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:43.542261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:43.558564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 319/622] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:43.570918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:43.701789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da49a6-b575-4d57-8626-5c4aae1f3618 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:43.741842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:43.742051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020046a8-914b-48ff-96e2-8734bddebba4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:43.742844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:43.743271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:43.743765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:43.752539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:43.754823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:43.769088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:43.770222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:43.771256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:43.771256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:43.771256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:43.771256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:43.771256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:43.771256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:43.771256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:43.771256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:43.773926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 320/623] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:43.783157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:43.798899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:43.799633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:43.799919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:43.800192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:43.800842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:43.801145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:43.803095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:43.816769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:43.829088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 304/624] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:43.834651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:43.947092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c2cdb-73bf-42bc-90f4-415d131db7fb None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:43.970595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:43.992652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007e3d5-61f2-40f7-a251-8aa59a2287fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:43.993434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e3d5-61f2-40f7-a251-8aa59a2287fb None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:43.995069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e3d5-61f2-40f7-a251-8aa59a2287fb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:43.995352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007e3d5-61f2-40f7-a251-8aa59a2287fb None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:43.996059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007e3d5-61f2-40f7-a251-8aa59a2287fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:43.996364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007e3d5-61f2-40f7-a251-8aa59a2287fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:43.998388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007e3d5-61f2-40f7-a251-8aa59a2287fb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:44.011258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6a005-3ca7-4cab-9e41-5a3dc357615e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:44.015103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 321/625] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:44.021625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00eda-643e-43e8-a355-72405b830b86 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.021919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00eda-643e-43e8-a355-72405b830b86 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.022197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00eda-643e-43e8-a355-72405b830b86 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.023949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 322/626] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:44.025169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00eda-643e-43e8-a355-72405b830b86 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:44.067254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430acf8-1bd1-40e7-8138-1795bcedc38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:44.068301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430acf8-1bd1-40e7-8138-1795bcedc38c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.068658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430acf8-1bd1-40e7-8138-1795bcedc38c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.069055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430acf8-1bd1-40e7-8138-1795bcedc38c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.079668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430acf8-1bd1-40e7-8138-1795bcedc38c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:44.081207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430acf8-1bd1-40e7-8138-1795bcedc38c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a430acf8-1bd1-40e7-8138-1795bcedc38c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:44.095249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:44.096435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:44.097870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:44.098478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 305/627] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:16:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:44.099690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758bb4-d365-4296-8412-ecb6734a6f36 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.099974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758bb4-d365-4296-8412-ecb6734a6f36 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.100249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758bb4-d365-4296-8412-ecb6734a6f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.122300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7d758bb4-d365-4296-8412-ecb6734a6f36 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:44.123722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7d758bb4-d365-4296-8412-ecb6734a6f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:44.135643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:44.172364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00eda-643e-43e8-a355-72405b830b86 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:44.213684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 306/628] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:44.215380 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d758bb4-d365-4296-8412-ecb6734a6f36 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:44.225712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4241-216c-416b-99f0-565d13854b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:44.227407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4241-216c-416b-99f0-565d13854b25 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.227873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4241-216c-416b-99f0-565d13854b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.229071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4241-216c-416b-99f0-565d13854b25 None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/8442dc046cb64619b62823b8bcc7cc4b/roles/509e1b745fb24a048d7ff490dc477940` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.253826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4241-216c-416b-99f0-565d13854b25 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=8442dc046cb64619b62823b8bcc7cc4b, role_id=509e1b745fb24a048d7ff490dc477940)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:44.255512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4241-216c-416b-99f0-565d13854b25 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:44.304889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:44.345022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 323/629] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:16:44 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/8442dc046cb64619b62823b8bcc7cc4b/roles/509e1b745fb24a048d7ff490dc477940 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:44.365035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d758bb4-d365-4296-8412-ecb6734a6f36 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:44.404185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04395fa6-e6c3-4170-a7c1-ac20aec38bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:44.404827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395fa6-e6c3-4170-a7c1-ac20aec38bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.405064 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395fa6-e6c3-4170-a7c1-ac20aec38bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.405394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395fa6-e6c3-4170-a7c1-ac20aec38bb4 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.406311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04395fa6-e6c3-4170-a7c1-ac20aec38bb4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:44.406664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04395fa6-e6c3-4170-a7c1-ac20aec38bb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:44.408124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04395fa6-e6c3-4170-a7c1-ac20aec38bb4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:44.427778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 307/630] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:16:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:44.434773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4241-216c-416b-99f0-565d13854b25 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:44.473582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115172-926c-4b55-a888-ebf7505ca20b None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.473954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115172-926c-4b55-a888-ebf7505ca20b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.474236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115172-926c-4b55-a888-ebf7505ca20b None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.475845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 308/631] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:44.481583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414fd39-c0d3-438c-be66-3765fc3f4325 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.482226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414fd39-c0d3-438c-be66-3765fc3f4325 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.482772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414fd39-c0d3-438c-be66-3765fc3f4325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.503421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e414fd39-c0d3-438c-be66-3765fc3f4325 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:44.505006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e414fd39-c0d3-438c-be66-3765fc3f4325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:44.559989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4241-216c-416b-99f0-565d13854b25 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:44.607174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:44.616684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebe622-0cce-49b3-b053-e607dd110b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:44.617663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebe622-0cce-49b3-b053-e607dd110b1d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.618224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebe622-0cce-49b3-b053-e607dd110b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.619055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebe622-0cce-49b3-b053-e607dd110b1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.628700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 309/632] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:44.629895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414fd39-c0d3-438c-be66-3765fc3f4325 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:44.682458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:44.707005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebe622-0cce-49b3-b053-e607dd110b1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:44.708642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebe622-0cce-49b3-b053-e607dd110b1d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:44.771473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414fd39-c0d3-438c-be66-3765fc3f4325 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:44.809983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79a195-d5bf-4381-9fa4-707a06ba20ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:44.811645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79a195-d5bf-4381-9fa4-707a06ba20ea None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.812341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79a195-d5bf-4381-9fa4-707a06ba20ea None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.813059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79a195-d5bf-4381-9fa4-707a06ba20ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.826489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79a195-d5bf-4381-9fa4-707a06ba20ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1e79a195-d5bf-4381-9fa4-707a06ba20ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:44.831129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:44.832062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:44.832939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:44.837014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 310/633] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:44.838393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529d19-21f8-42e1-8139-769cab4a7872 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.838676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529d19-21f8-42e1-8139-769cab4a7872 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.845453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529d19-21f8-42e1-8139-769cab4a7872 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.845453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 311/634] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:44.845453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529d19-21f8-42e1-8139-769cab4a7872 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:44.857602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 324/635] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:44.862872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283cca-1e1c-4df9-ab5b-af57c53a9f70 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:44.863944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283cca-1e1c-4df9-ab5b-af57c53a9f70 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:44.864214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b283cca-1e1c-4df9-ab5b-af57c53a9f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:44.882506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-6b283cca-1e1c-4df9-ab5b-af57c53a9f70 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:44.883869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6b283cca-1e1c-4df9-ab5b-af57c53a9f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:44.902980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:44.958561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 325/636] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:44.959410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283cca-1e1c-4df9-ab5b-af57c53a9f70 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:44.969720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529d19-21f8-42e1-8139-769cab4a7872 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:44.973494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:45.020162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.021097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.021387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.021754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.022499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:45.022917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.024310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.034454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 312/637] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:45.035449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.073654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b283cca-1e1c-4df9-ab5b-af57c53a9f70 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.109976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.111125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.111666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.112143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.125387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.127181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:45.147839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:45.148837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:45.149860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:45.149860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:45.149860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:45.151553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773bc02-4289-4727-a1bb-75f610ab02ec None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.153743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 326/638] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:45.155477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.166285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:45.194400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b95214-3f8a-4db0-b102-27c970d97209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.195666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b95214-3f8a-4db0-b102-27c970d97209 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.196357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b95214-3f8a-4db0-b102-27c970d97209 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.197073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b95214-3f8a-4db0-b102-27c970d97209 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.210067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b95214-3f8a-4db0-b102-27c970d97209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c1b95214-3f8a-4db0-b102-27c970d97209 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:45.218904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:45.219921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:45.220793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:45.228148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 313/639] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:45.228148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b95214-3f8a-4db0-b102-27c970d97209 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.257215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:45.277083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f05ef-aaf8-4079-8448-bf9be1596df3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.313327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.313993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.314258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.314527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.324853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.327082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.334471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b95214-3f8a-4db0-b102-27c970d97209 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:45.343462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:45.344410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:45.345310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:45.345310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:45.345310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:45.345310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 327/640] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:45.345310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.376794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.377394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.377703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.377977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.378620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:45.378923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.380387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.392089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 314/641] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:45.392918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.413878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:45.458383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e8c58-47a7-4198-9187-6d8d05615214 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.481212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:45.495238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bdd6-0392-40f3-8f2a-6a79c3df44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.495918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bdd6-0392-40f3-8f2a-6a79c3df44d5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.496196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bdd6-0392-40f3-8f2a-6a79c3df44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.496468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076bdd6-0392-40f3-8f2a-6a79c3df44d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.496852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14bbe0-0abf-412d-aef1-f45ef558593f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.506829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076bdd6-0392-40f3-8f2a-6a79c3df44d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b076bdd6-0392-40f3-8f2a-6a79c3df44d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:45.512323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:45.513349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 328/642] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:45.514364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bdd6-0392-40f3-8f2a-6a79c3df44d5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.546451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.546994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.547273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.547542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.548213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:45.548514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.549903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.561579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 315/643] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:45.562265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.630072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076bdd6-0392-40f3-8f2a-6a79c3df44d5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.650292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:45.667760 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411664ba-7747-4b9b-93d3-1ff521a55911 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.669740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.670478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.670762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.671039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.671693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:45.671999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.673380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.687023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 329/644] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:45.687976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.707864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.708495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.708783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.709062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.715932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.717372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:45.729319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:45.730243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:45.731301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:45.731301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:45.731301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:45.731301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:45.731301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:45.731301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:45.731301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:45.731301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:45.735147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 316/645] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:45.735839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.747982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:45.803375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f82f-be66-4558-b228-b3e487a3813b None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.839550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3a837-c64e-48da-94dd-205acad650ff None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.840078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.840687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.841068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.841326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.842497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:45.842497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.843698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.857137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 330/646] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:45.857137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.880318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:45.880944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:45.881227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:45.881501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:45.892187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:45.893652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:45.901192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:45.909378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:45.910451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:45.911387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:45.911387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:45.911387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:45.911387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 317/647] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:45.912178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:45.969530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4f83-8ae7-4518-b44b-8df252de4bd3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:45.973836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:46.005534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.006434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.006720 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.006993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] PATH_INFO: `/v3/users/glance` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.014671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.016141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.017943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae6ab-a86b-40a2-915b-069fd93e2771 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:46.028909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:46.029949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 331/648] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:46.030943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.066204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.066814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.067098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.067373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.068072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:46.068376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.069894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.086845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 318/649] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:46.086845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.148033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:46.151764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1f1f-21f8-4bc8-8c14-b840dccf90df None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.188363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.188997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.189289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.189558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.194780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9ac20-ea0e-4376-966b-f725a7f6496d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.203763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.205574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.216996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:46.221963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:46.222926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:46.223834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:46.223834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:46.223834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:46.228471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 332/650] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:46.229067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.233865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.234480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.234857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.235133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.235835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:46.236139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.237840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.256292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 319/651] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:46.257192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.339438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b17b-99d3-42ca-9756-0da05a253589 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.365136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a1a66-eddc-481f-8307-0628fb2f5f8c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.375952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.376579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.377140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.377442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.378208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:46.378516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.379956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.396878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 333/652] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:46.397734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.405791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.406661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.407149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.407580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.408320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=33ac116b19864bd694ca089dd5f7e010) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:46.408631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.410136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.410948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:46.421719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 320/653] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/role_assignments?user.id=33ac116b19864bd694ca089dd5f7e010&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:46.421719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.495005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:46.526668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21bfcf-0c65-49e7-bec9-a4389ff6f678 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.561106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19808f34-f974-4289-82ca-a75dc3668d44 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.564464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.565078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.565361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.565658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.566324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:46.566629 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.568027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.580520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 334/654] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:46.581360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.605395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4446de-263d-42c0-89e2-c3d95ed29d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.606495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4446de-263d-42c0-89e2-c3d95ed29d71 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.606495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4446de-263d-42c0-89e2-c3d95ed29d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.606667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4446de-263d-42c0-89e2-c3d95ed29d71 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.616189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4446de-263d-42c0-89e2-c3d95ed29d71 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.618121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4446de-263d-42c0-89e2-c3d95ed29d71 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-6b4446de-263d-42c0-89e2-c3d95ed29d71 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:46.629819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:46.630762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:46.631707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 321/655] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:46.632397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef4b9-4885-4f36-9a5e-d89e9eab32e7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.632397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef4b9-4885-4f36-9a5e-d89e9eab32e7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.633040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef4b9-4885-4f36-9a5e-d89e9eab32e7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.634913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 322/656] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:46.635651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ef4b9-4885-4f36-9a5e-d89e9eab32e7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.671799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:46.703024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae4794-fded-4c44-9579-c935ab5303cc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.742487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7424246-9d60-4131-b3c9-a543d31c440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.743099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7424246-9d60-4131-b3c9-a543d31c440e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.743585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7424246-9d60-4131-b3c9-a543d31c440e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.743695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7424246-9d60-4131-b3c9-a543d31c440e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.747424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ef4b9-4885-4f36-9a5e-d89e9eab32e7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.750589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:46.783723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.784349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.784625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.784894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.793194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.794670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:46.807009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:46.808025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:16:46.809552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:46.812729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 323/657] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:46.813577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:46.823584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7424246-9d60-4131-b3c9-a543d31c440e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.825416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7424246-9d60-4131-b3c9-a543d31c440e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.900107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:46.921182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af6cf0-edd9-45e6-a21c-33f95113d544 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:46.936201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 335/658] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:46.936201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932236eb-977c-4a10-b931-c88372caa776 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.936201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932236eb-977c-4a10-b931-c88372caa776 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.936201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932236eb-977c-4a10-b931-c88372caa776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.951741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-932236eb-977c-4a10-b931-c88372caa776 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:46.952927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-932236eb-977c-4a10-b931-c88372caa776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:46.964460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:46.965058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:46.965333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:46.965599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:46.966455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:46.966759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:46.968291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:46.990895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 324/659] 10.222.0.61 () {56 vars in 1137 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:46.990895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.016078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.029790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 336/660] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:47.029790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932236eb-977c-4a10-b931-c88372caa776 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.105967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2815b-d5da-4f86-bb35-3a558e273546 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.143614 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.144388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.144761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.145129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.145985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:47.146385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:47.148015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:47.163100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.167531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 325/661] 10.222.0.61 () {56 vars in 1139 bytes} [Tue Aug 23 16:16:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:47.167834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932236eb-977c-4a10-b931-c88372caa776 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.172973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.210858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.211721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.212172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.212617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.226999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:47.229872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:47.249570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:47.250768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:47.251839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:47.251839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:47.251839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:47.254024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 337/662] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:47.255071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.260455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.280398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa71eb7-83ea-4f93-b77d-bc36da5ebfcf None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.318351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520e4f-7eaa-460f-bb4a-7a1c38d81ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.318825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520e4f-7eaa-460f-bb4a-7a1c38d81ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.319324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520e4f-7eaa-460f-bb4a-7a1c38d81ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.319662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520e4f-7eaa-460f-bb4a-7a1c38d81ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.375789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386bc63-5257-4384-ba7b-fbf1b4f86ac2 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.391670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14520e4f-7eaa-460f-bb4a-7a1c38d81ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:47.393224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14520e4f-7eaa-460f-bb4a-7a1c38d81ad7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:47.409223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1042-9f6c-46ee-9701-0468c0f8ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.409864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1042-9f6c-46ee-9701-0468c0f8ab8d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.410145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1042-9f6c-46ee-9701-0468c0f8ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.410412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a1042-9f6c-46ee-9701-0468c0f8ab8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.431474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.480780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.481081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a1042-9f6c-46ee-9701-0468c0f8ab8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:47.483060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a1042-9f6c-46ee-9701-0468c0f8ab8d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:47.506129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 326/663] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:47.506129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520e4f-7eaa-460f-bb4a-7a1c38d81ad7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.597659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 338/664] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:47.597862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1042-9f6c-46ee-9701-0468c0f8ab8d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.615240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520e4f-7eaa-460f-bb4a-7a1c38d81ad7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.651281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.654965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.655570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.655851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.656121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.656763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:47.657060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:47.658508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:47.675904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 327/665] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:47.675904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.701893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a1042-9f6c-46ee-9701-0468c0f8ab8d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.721787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.736239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466e452-f7fc-4843-936a-40fd99103daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.736977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466e452-f7fc-4843-936a-40fd99103daf None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.737517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466e452-f7fc-4843-936a-40fd99103daf None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.737874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466e452-f7fc-4843-936a-40fd99103daf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.749040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466e452-f7fc-4843-936a-40fd99103daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-f466e452-f7fc-4843-936a-40fd99103daf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:47.754131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:47.755059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:47.755911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 339/666] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:47.756600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466e452-f7fc-4843-936a-40fd99103daf None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.790327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab2d2-0de3-402b-9ce9-a94b019dab05 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.828764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.829397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.829707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.829988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.842174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:47.843786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:47.859107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:47.860745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:47.861680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:47.861680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:47.861680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:47.861680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 328/667] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:47.861680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.869936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466e452-f7fc-4843-936a-40fd99103daf None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:47.884851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.906986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:47.907855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:47.908135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:47.908443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:47.918913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:47.920567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:47.936256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:47.937233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:47.938197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:47.938197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:47.938197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:47.938197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 340/668] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:47.938197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:47.961288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:47.971306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0b70b-7e1b-4ba3-b468-8c4f09778473 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.010052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.010682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.011020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.011298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.018284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.019736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:48.031846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:48.032759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:48.033711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 329/669] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:48.034200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.054352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8042a0-2667-4d57-b828-99dd85b310b5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.092541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.093151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.093441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.093737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.094414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:48.094718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.096117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.104477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 341/670] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:48.105289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.135777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:48.153706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96345f06-6a64-426e-8dc6-d41974133d0b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.189054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.189684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.189965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.190235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.190871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:48.191172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.192528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.205128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 330/671] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:48.205966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.217785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b48e3-20a4-42c1-800a-13872b7145a8 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.222504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:48.252677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.253290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.253571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.253874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.254524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:48.254832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.256225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.273524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 342/672] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:48.273524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.324158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444f5f-09a1-4e3e-8b0f-1a002175c82a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.355935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:48.359863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.360469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.360745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.361013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.361750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:48.362114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.363815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.371631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779f9f9-0c08-4668-a403-45dc4437d0a3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.380554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 331/673] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:48.380554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.409056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.409721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.409998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.410270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.420873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.422442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:48.437055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:48.438256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:48.439327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:48.439327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:48.439327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:48.439327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 343/674] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:48.439327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.452575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:48.483719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fcec4-3340-46e6-b502-4729965cb44b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.516414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.517050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.517305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.517579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.524099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.526098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:48.537096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:48.538208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 332/675] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:48.539127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.543567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4e112-caa0-441d-a508-e0e21ab9ad9d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.578600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7043e-1f36-4511-a311-4356b43fa400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.579219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7043e-1f36-4511-a311-4356b43fa400 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.579496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7043e-1f36-4511-a311-4356b43fa400 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.579791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7043e-1f36-4511-a311-4356b43fa400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.586317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7043e-1f36-4511-a311-4356b43fa400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.588346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7043e-1f36-4511-a311-4356b43fa400 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.590048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-c5d7043e-1f36-4511-a311-4356b43fa400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:48.601406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:48.607063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 344/676] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07180f3-627f-4951-9d85-d89e247f2b0c None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.607994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07180f3-627f-4951-9d85-d89e247f2b0c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.608618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07180f3-627f-4951-9d85-d89e247f2b0c None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.608618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 345/677] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:48.608618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07180f3-627f-4951-9d85-d89e247f2b0c None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.645140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503b69-e5e7-4da5-b171-20eb51303815 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.673497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:48.678913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.679505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.679785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.680054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.680823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=f8070d1891844da59196d00ebbdff832) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:48.681114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.682563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.688404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 333/678] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/role_assignments?user.id=f8070d1891844da59196d00ebbdff832&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:48.690621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.719724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07180f3-627f-4951-9d85-d89e247f2b0c None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.760098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.760628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.760911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.761180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.761875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:48.762197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.763621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.777728 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 346/679] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:48.778603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.816826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5ec60-e780-40df-9839-ecbd384c345a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.845816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:48.860654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c8c4e-5f8d-4268-8694-1740ce05810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.861348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8c4e-5f8d-4268-8694-1740ce05810a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.861645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8c4e-5f8d-4268-8694-1740ce05810a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.861918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8c4e-5f8d-4268-8694-1740ce05810a None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.862875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c8c4e-5f8d-4268-8694-1740ce05810a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:48.863223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c8c4e-5f8d-4268-8694-1740ce05810a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.864645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c8c4e-5f8d-4268-8694-1740ce05810a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.878395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 334/680] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:48.879904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d228d0-ea50-4631-a9b5-6441d2a03bf2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.885915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d228d0-ea50-4631-a9b5-6441d2a03bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.885915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d228d0-ea50-4631-a9b5-6441d2a03bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.899140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b7d228d0-ea50-4631-a9b5-6441d2a03bf2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:48.899559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c7b8f-2e16-4528-a49d-29fff0c88bb1 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:48.901060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b7d228d0-ea50-4631-a9b5-6441d2a03bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:48.938502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:48.939106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:48.939385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:48.939651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:48.940342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:48.940632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:48.942157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:48.958682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 347/681] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:48.958682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:48.963909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:48.982479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 335/682] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:48.993640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d228d0-ea50-4631-a9b5-6441d2a03bf2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.083700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc11f-5583-4d63-ac5a-3f2d70f8acc8 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.102842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:49.120556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.122145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.122145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.122145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.128688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d228d0-ea50-4631-a9b5-6441d2a03bf2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.129985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:49.131825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:49.145498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:49.147276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 348/683] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:49.150426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.173626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.174298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.174852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.175172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.176204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=1a81f47e4b004716bf54175c55606d70) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:49.176509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:49.178677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:49.188156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 336/684] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:48 2022] GET /identity/v3/role_assignments?user.id=1a81f47e4b004716bf54175c55606d70&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:49.188993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.298045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:49.305146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e6bc8-8749-49f9-a457-a8c1e6b8a910 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.344500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b35c7-8b7a-4016-b5d0-4a663fdde389 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.344964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.345840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.346487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.347800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.348767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=3d5b15e9f0414836b3611a8ff6085b80) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:49.349315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:49.351076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:49.361737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 349/685] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/role_assignments?user.id=3d5b15e9f0414836b3611a8ff6085b80&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:49.362903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.386121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.386749 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.387031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.387307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.388057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:49.388423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:49.390122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:49.417763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 337/686] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:49.419922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.441997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:49.502089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab01405-2cca-4544-a85c-abb3d3902b3a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.545808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f027a-1142-47ac-8a59-42f6ff9df213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.548554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f027a-1142-47ac-8a59-42f6ff9df213 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.548554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f027a-1142-47ac-8a59-42f6ff9df213 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.548554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f027a-1142-47ac-8a59-42f6ff9df213 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.564802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f027a-1142-47ac-8a59-42f6ff9df213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:49.568096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c731c56-9784-46c3-a889-de36088550a0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-fa8f027a-1142-47ac-8a59-42f6ff9df213 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:49.577116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:49.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:49.579586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:49.582066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:49.583603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 350/687] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:49.590457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f027a-1142-47ac-8a59-42f6ff9df213 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.617408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01989-d541-46b7-9c94-922516e4b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.618314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01989-d541-46b7-9c94-922516e4b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.619522 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01989-d541-46b7-9c94-922516e4b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.619977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f01989-d541-46b7-9c94-922516e4b6a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.705421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f01989-d541-46b7-9c94-922516e4b6a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:49.707165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f01989-d541-46b7-9c94-922516e4b6a6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:49.714943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f027a-1142-47ac-8a59-42f6ff9df213 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.716607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:49.753130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.753764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.754149 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.754545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.755409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:49.755718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:49.757515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:49.766568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 351/688] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:49.772254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.819315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 338/689] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:16:49.827222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01989-d541-46b7-9c94-922516e4b6a6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:49.847796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:49.901018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612e49-4126-4cfe-b164-9eb12385a021 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:49.939473 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:49.940508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:49.941015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:49.941508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:49.954494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:49.956276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:49.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:49.974649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:49.975599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:49.975599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:49.975599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:49.977878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 352/690] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:49.986678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:50.029975 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:50.068138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f01989-d541-46b7-9c94-922516e4b6a6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:50.104944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:50.105643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:50.105935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:50.106208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:50.117031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:50.118544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:50.134538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:50.135533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:50.136450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:50.136450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:50.136450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:50.136450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 339/691] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:50.143835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:50.194930 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f47135-0c4e-48d4-a290-e1be481a56e3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:50.233736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:50.276019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:50.276573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:50.276876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:50.277132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:50.277824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:50.278116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:50.279497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:50.297933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4899-bc1c-4c1c-ad58-c97592866290 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:50.313747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 353/692] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:50.330914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:50.366235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:50.367357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:50.367357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:50.367357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:50.369184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:50.369184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:50.370261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:50.383184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 340/693] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:50.398069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:50.433807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:50.459963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721c7d-8512-4503-8029-8faeaddf900f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:50.504487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:50.505141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:50.505424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:50.505723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:50.517298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b44f6b-10aa-4ba3-a313-6acae722c26a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:50.525635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:50.525635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:50.531748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:50.532741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:50.535092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 354/694] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:16:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:50.541650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:50.569270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:50.619239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:50.619918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:50.620202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:50.620479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:50.638677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:50.640225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:50.659659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:50.660639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:50.661529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:50.661529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:50.661529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:50.661529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:50.661529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:50.661529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:50.661529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:50.661529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:50.664029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 341/695] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:50.672121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:50.815187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59594-884c-4ea2-b882-44defccf720d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:50.855183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbaa6b-c612-4379-9ab5-1243d0569ba5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:50.885905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:50.886529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:50.886808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:50.887078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:50.887822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:50.888128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:50.891492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:50.902975 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:50.927158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:50.927754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 355/696] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:16:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:50.927878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:50.928169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:50.928498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:50.929209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:50.929520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:50.931793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:50.932992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:50.946204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 342/697] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:50.952403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:51.015130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:51.079759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eec79-c148-4a03-ad4a-7c3837306302 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:51.085834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9604172-250b-4254-ba70-a8518d514f00 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:51.115669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1f312-51d2-4604-bd56-27e2cdd6493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:51.116378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1f312-51d2-4604-bd56-27e2cdd6493b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.116784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1f312-51d2-4604-bd56-27e2cdd6493b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.117145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1f312-51d2-4604-bd56-27e2cdd6493b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.124328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb268e7-7d5f-427c-a8b9-b44750d0bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:51.125173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb268e7-7d5f-427c-a8b9-b44750d0bb8e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.125649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb268e7-7d5f-427c-a8b9-b44750d0bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.126099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb268e7-7d5f-427c-a8b9-b44750d0bb8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.126983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb268e7-7d5f-427c-a8b9-b44750d0bb8e None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=8442dc046cb64619b62823b8bcc7cc4b) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:51.127453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb268e7-7d5f-427c-a8b9-b44750d0bb8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:51.129058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb268e7-7d5f-427c-a8b9-b44750d0bb8e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:51.136544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 343/698] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:50 2022] GET /identity/v3/role_assignments?user.id=8442dc046cb64619b62823b8bcc7cc4b&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:51.138167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d0787-773c-480c-bb51-f4036c7cc091 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.138669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d0787-773c-480c-bb51-f4036c7cc091 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.139128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d0787-773c-480c-bb51-f4036c7cc091 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.140981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 344/699] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:51.152373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72bd14-6c0e-448e-a077-b43193fc1fd9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.152600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72bd14-6c0e-448e-a077-b43193fc1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.152857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72bd14-6c0e-448e-a077-b43193fc1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.198610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1f312-51d2-4604-bd56-27e2cdd6493b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:51.200113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1f312-51d2-4604-bd56-27e2cdd6493b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:51.209067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:51.214823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ca72bd14-6c0e-448e-a077-b43193fc1fd9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:51.216056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ca72bd14-6c0e-448e-a077-b43193fc1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:51.347238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 356/701] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:16:51.349774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 345/701] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:51.352628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1f312-51d2-4604-bd56-27e2cdd6493b None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:51.450529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:51.460194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1f312-51d2-4604-bd56-27e2cdd6493b None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:51.500172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:51.501198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.501721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.502223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.513035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:51.514794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:51.529047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12618429-2a21-4fc6-a8b5-b38422ab1a03 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.529356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12618429-2a21-4fc6-a8b5-b38422ab1a03 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.529601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12618429-2a21-4fc6-a8b5-b38422ab1a03 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.531071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 346/702] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:51.534147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:51.535085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:51.536079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:51.536079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:51.536079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:51.536079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 357/703] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:51.539060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edec7a-f6c1-475c-9d11-397a5428a5c9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.539805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edec7a-f6c1-475c-9d11-397a5428a5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.540337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edec7a-f6c1-475c-9d11-397a5428a5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.541098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:51.563668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a3edec7a-f6c1-475c-9d11-397a5428a5c9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:51.565384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a3edec7a-f6c1-475c-9d11-397a5428a5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:51.606822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:51.658740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd675-4e3e-491b-a9df-6e1d9de2bdfc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:51.668092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 347/704] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:51.668622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edec7a-f6c1-475c-9d11-397a5428a5c9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:51.695267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:51.697260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.697786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.698257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.699252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:51.700026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:51.702051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:51.718504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 358/705] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:51.724195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:51.733341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:51.808441 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edec7a-f6c1-475c-9d11-397a5428a5c9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:51.856994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6e22f-7b92-452d-9ed4-d436a49ffb38 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:51.868585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdec48-ad8a-4297-b2b5-a342c3d1e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:51.869834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdec48-ad8a-4297-b2b5-a342c3d1e0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.870119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdec48-ad8a-4297-b2b5-a342c3d1e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.876176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdec48-ad8a-4297-b2b5-a342c3d1e0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.891240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdec48-ad8a-4297-b2b5-a342c3d1e0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:51.892747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdec48-ad8a-4297-b2b5-a342c3d1e0b0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:51.898402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7e1e0-d6da-47db-8c4e-8902de0a1c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:51.899044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e1e0-d6da-47db-8c4e-8902de0a1c97 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.899321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e1e0-d6da-47db-8c4e-8902de0a1c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.899593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7e1e0-d6da-47db-8c4e-8902de0a1c97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.908517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7e1e0-d6da-47db-8c4e-8902de0a1c97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dbfdec48-ad8a-4297-b2b5-a342c3d1e0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:51.909377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:51.910333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:51.911268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:51.911268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:51.911268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:51.911452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7e1e0-d6da-47db-8c4e-8902de0a1c97 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:51.911526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 348/706] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:51.912941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3110560-232d-4686-a098-f929a99c7002 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.912941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3110560-232d-4686-a098-f929a99c7002 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.912941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3110560-232d-4686-a098-f929a99c7002 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.917772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 349/707] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:51.918576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3110560-232d-4686-a098-f929a99c7002 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-ccc7e1e0-d6da-47db-8c4e-8902de0a1c97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:51.924460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:51.926554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 359/708] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c54a30-c9c2-4af3-b99a-4e8ce1f33589 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:51.928659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c54a30-c9c2-4af3-b99a-4e8ce1f33589 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:51.929539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c54a30-c9c2-4af3-b99a-4e8ce1f33589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:51.945522 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:51.952514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-47c54a30-c9c2-4af3-b99a-4e8ce1f33589 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:51.954374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-47c54a30-c9c2-4af3-b99a-4e8ce1f33589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:52.034775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:52.038607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3110560-232d-4686-a098-f929a99c7002 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.043755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 360/709] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:52.044649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c54a30-c9c2-4af3-b99a-4e8ce1f33589 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.079583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.080461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.080741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.081012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.081950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:52.082661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.084570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.099706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 350/710] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:52.100547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.190203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c54a30-c9c2-4af3-b99a-4e8ce1f33589 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.200612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:52.231417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a217b-209b-4bb2-9469-923efdcae06c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.239964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.240896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.241413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.242378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.243288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:52.244309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.246465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.267624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 361/711] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:52.267624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.278772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.279839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.280343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.280878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.281833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.283470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:52.297963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:52.306006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:52.307009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 351/712] 10.222.0.61 () {56 vars in 1129 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:52.308234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.337158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:52.386157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb296a-1fcb-44a9-848b-9fa67e141a02 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.419105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84790-46a1-4b57-a704-92cc363825c9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.421823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910454-9e0d-48f8-8009-f5fbabfac9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.422422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910454-9e0d-48f8-8009-f5fbabfac9a6 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.422699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910454-9e0d-48f8-8009-f5fbabfac9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.422969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910454-9e0d-48f8-8009-f5fbabfac9a6 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.423598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26910454-9e0d-48f8-8009-f5fbabfac9a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.425024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26910454-9e0d-48f8-8009-f5fbabfac9a6 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.454833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.455393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.455669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.455937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.456663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=33ac116b19864bd694ca089dd5f7e010) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:52.456970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.458589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.464124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 352/713] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/role_assignments?user.id=33ac116b19864bd694ca089dd5f7e010&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:52.465319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.480196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:52.482723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 362/714] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:16:52 2022] POST /identity/v3/users => generated 254 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:52.489902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910454-9e0d-48f8-8009-f5fbabfac9a6 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.604367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a6589-ef68-452a-9b5d-61b63430d389 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.647075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.648604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.649146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.650169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.651642 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:52.652230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.654226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.659703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910454-9e0d-48f8-8009-f5fbabfac9a6 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.660453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 353/715] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:52.666220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.684215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:52.710043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.710629 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.710908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.711179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] PATH_INFO: `/v3/services/network` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.711797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.714114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:52.730513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:52.731665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:52.732545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 363/716] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:52.738082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:52.761151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:52.800453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c1014-e3b7-481e-be59-9df1571db489 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.838721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.839377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.839655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.840099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.840734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:52.841034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.842615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.849030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 354/717] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:52.867409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd18be4-bc36-4248-8eb9-6c058d21644b None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:52.921536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81607b3-c8ca-48f0-8b79-fa6ea6865d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:52.922207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81607b3-c8ca-48f0-8b79-fa6ea6865d4a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:52.922488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81607b3-c8ca-48f0-8b79-fa6ea6865d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:52.922761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81607b3-c8ca-48f0-8b79-fa6ea6865d4a None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:52.923409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81607b3-c8ca-48f0-8b79-fa6ea6865d4a None admin] RBAC: Adding query filter params (name=network) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:52.923713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81607b3-c8ca-48f0-8b79-fa6ea6865d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:52.925181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81607b3-c8ca-48f0-8b79-fa6ea6865d4a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:52.930747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 364/718] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:52.936479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:53.079210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5674a4-946a-49ad-84ea-76e5cab00239 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:53.110147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:53.115370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a7a9a-3912-42e8-8aa5-7d15fceb661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:53.116039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7a9a-3912-42e8-8aa5-7d15fceb661f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:53.116388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7a9a-3912-42e8-8aa5-7d15fceb661f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:53.116751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7a9a-3912-42e8-8aa5-7d15fceb661f None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:53.117354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a7a9a-3912-42e8-8aa5-7d15fceb661f None admin] RBAC: Adding query filter params (type=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:53.125280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a7a9a-3912-42e8-8aa5-7d15fceb661f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:53.125280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a7a9a-3912-42e8-8aa5-7d15fceb661f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:53.125280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 355/719] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:16:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:53.658669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa3b55-1f17-460a-893a-eafa165edbb7 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:53.659210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa3b55-1f17-460a-893a-eafa165edbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:53.659210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa3b55-1f17-460a-893a-eafa165edbb7 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:53.660818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 365/720] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:53.666489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf7549-95fb-4b0d-b044-ed27e605dff4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:53.666910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf7549-95fb-4b0d-b044-ed27e605dff4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:53.667079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf7549-95fb-4b0d-b044-ed27e605dff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:53.694925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d7cf7549-95fb-4b0d-b044-ed27e605dff4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:53.696151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d7cf7549-95fb-4b0d-b044-ed27e605dff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:53.785449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 356/721] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:54.264614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa3b55-1f17-460a-893a-eafa165edbb7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:54.324450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:54.403279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa3b55-1f17-460a-893a-eafa165edbb7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:54.456183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246fd8-bbc0-4e98-b459-737a11a21ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:54.456818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246fd8-bbc0-4e98-b459-737a11a21ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:54.457101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246fd8-bbc0-4e98-b459-737a11a21ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:54.457374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246fd8-bbc0-4e98-b459-737a11a21ea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:54.471684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e246fd8-bbc0-4e98-b459-737a11a21ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-6e246fd8-bbc0-4e98-b459-737a11a21ea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:54.476878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:54.477920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:54.478781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:54.479416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 366/722] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:54.484250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf7549-95fb-4b0d-b044-ed27e605dff4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:54.586645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf7549-95fb-4b0d-b044-ed27e605dff4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:54.622280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:54.627218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284e5c-4518-423d-b675-35c36e7feea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:54.627837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284e5c-4518-423d-b675-35c36e7feea0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:54.628107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284e5c-4518-423d-b675-35c36e7feea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:54.628379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284e5c-4518-423d-b675-35c36e7feea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:54.629053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99284e5c-4518-423d-b675-35c36e7feea0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:54.629355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99284e5c-4518-423d-b675-35c36e7feea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:54.630763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99284e5c-4518-423d-b675-35c36e7feea0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:54.644573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 357/723] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:54.650933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246fd8-bbc0-4e98-b459-737a11a21ea0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:54.780530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:54.786357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246fd8-bbc0-4e98-b459-737a11a21ea0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:54.820849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:54.821553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:54.821862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:54.822136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:54.832397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:54.833877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:54.848404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:54.849363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:54.850820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:54.850820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:54.850820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:54.852635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 367/724] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:54.854826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32963d3d-a924-49fb-8331-109f7bbbcb33 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:54.855275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32963d3d-a924-49fb-8331-109f7bbbcb33 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:54.855451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32963d3d-a924-49fb-8331-109f7bbbcb33 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:54.856179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:54.858034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 358/725] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:54.862122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a891-f851-4fe0-aea7-e2d04f51ee77 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:54.862393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a891-f851-4fe0-aea7-e2d04f51ee77 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:54.862938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a891-f851-4fe0-aea7-e2d04f51ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:54.882609 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f9f6a891-f851-4fe0-aea7-e2d04f51ee77 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:54.884633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f9f6a891-f851-4fe0-aea7-e2d04f51ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:54.968854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 359/726] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:16:54.985202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456f54c-78d6-4656-8b27-1685bac35c71 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:54.985885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456f54c-78d6-4656-8b27-1685bac35c71 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:54.986412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456f54c-78d6-4656-8b27-1685bac35c71 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:54.988449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 360/727] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:16:54.994285 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d81e7-e0b5-4b73-9625-cfe2ab64bb63 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:54.994870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d81e7-e0b5-4b73-9625-cfe2ab64bb63 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:54.995353 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d81e7-e0b5-4b73-9625-cfe2ab64bb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.014990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d20d81e7-e0b5-4b73-9625-cfe2ab64bb63 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:55.019944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d20d81e7-e0b5-4b73-9625-cfe2ab64bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:55.084507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6921a3-41be-4a47-b13f-79ab6bc69e7e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.152020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a85230-fe5f-4590-918b-2415fc3f11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.152539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85230-fe5f-4590-918b-2415fc3f11f3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.152817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85230-fe5f-4590-918b-2415fc3f11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.154541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a85230-fe5f-4590-918b-2415fc3f11f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.155188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a85230-fe5f-4590-918b-2415fc3f11f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:55.155491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a85230-fe5f-4590-918b-2415fc3f11f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:55.156857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a85230-fe5f-4590-918b-2415fc3f11f3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:55.160563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 361/728] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:55.176812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 368/729] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:55.182596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d81e7-e0b5-4b73-9625-cfe2ab64bb63 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:55.247621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:55.266898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796e37-6fb2-4f43-a37e-78bcffece703 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.267224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796e37-6fb2-4f43-a37e-78bcffece703 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.267453 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796e37-6fb2-4f43-a37e-78bcffece703 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.268929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 369/730] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:55.269461 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796e37-6fb2-4f43-a37e-78bcffece703 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:55.290510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:55.303385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d81e7-e0b5-4b73-9625-cfe2ab64bb63 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.340946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9b5a-fd66-451d-a8a6-7d0499032d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.341603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9b5a-fd66-451d-a8a6-7d0499032d38 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.341881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9b5a-fd66-451d-a8a6-7d0499032d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.342151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9b5a-fd66-451d-a8a6-7d0499032d38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.349805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b9b5a-fd66-451d-a8a6-7d0499032d38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:55.351238 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b9b5a-fd66-451d-a8a6-7d0499032d38 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e71b9b5a-fd66-451d-a8a6-7d0499032d38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:55.363206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:55.364364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:55.365527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 362/731] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:55.366185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8acf1-4583-4446-9ab8-b7e8da524f2d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.366185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8acf1-4583-4446-9ab8-b7e8da524f2d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.366394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8acf1-4583-4446-9ab8-b7e8da524f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.385029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3cb8acf1-4583-4446-9ab8-b7e8da524f2d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:55.386244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3cb8acf1-4583-4446-9ab8-b7e8da524f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:55.409859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796e37-6fb2-4f43-a37e-78bcffece703 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.445042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d42f-7cf6-4de2-8a0b-395d25730408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.445728 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d42f-7cf6-4de2-8a0b-395d25730408 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.446010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d42f-7cf6-4de2-8a0b-395d25730408 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.446281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4d42f-7cf6-4de2-8a0b-395d25730408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.457292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4d42f-7cf6-4de2-8a0b-395d25730408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-6ca4d42f-7cf6-4de2-8a0b-395d25730408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:55.461984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:55.463163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:55.464111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 370/732] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:55.464889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d42f-7cf6-4de2-8a0b-395d25730408 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:55.480043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 363/733] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:55.485793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8acf1-4583-4446-9ab8-b7e8da524f2d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:55.544773 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:55.565569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:55.597944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4d42f-7cf6-4de2-8a0b-395d25730408 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.605778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8acf1-4583-4446-9ab8-b7e8da524f2d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.637366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.638205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.638487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.638761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.639490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:55.639793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:55.641027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.641222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:55.641793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.642141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.642497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.643274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:55.643643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:55.645083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:55.658304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 364/734] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:55.659256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:55.661665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 371/735] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Aug 23 16:16:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:55.662725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:55.763901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:55.767084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141c2d-b62b-4625-b010-15983ff08d45 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.797210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49601ec2-3d5e-42c1-b1e5-9555aa4d2ef4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.802914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff12cc-0d48-4843-94ab-2b616a84698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.803544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff12cc-0d48-4843-94ab-2b616a84698e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.803825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff12cc-0d48-4843-94ab-2b616a84698e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.804096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff12cc-0d48-4843-94ab-2b616a84698e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.814282 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff12cc-0d48-4843-94ab-2b616a84698e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-efff12cc-0d48-4843-94ab-2b616a84698e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:16:55.818900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:55.819810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:16:55.820656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:55.824698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 365/736] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:55.825494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff12cc-0d48-4843-94ab-2b616a84698e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:55.831289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:55.836896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.838748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.838748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.838748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.848306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:55.849782 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:55.865065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:55.868489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:55.869649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:55.869649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:55.869649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:55.869649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 372/737] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:55.869649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:55.958430 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff12cc-0d48-4843-94ab-2b616a84698e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.965883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695533d8-869c-486c-81d9-9c3d808e9156 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:55.991381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1aa3f-db7a-4dd3-a3e2-29b58a9fa911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.991977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1aa3f-db7a-4dd3-a3e2-29b58a9fa911 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.992261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1aa3f-db7a-4dd3-a3e2-29b58a9fa911 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.992529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1aa3f-db7a-4dd3-a3e2-29b58a9fa911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:55.998783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b0d5-ccbb-494b-9468-6386809c6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:55.999382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b0d5-ccbb-494b-9468-6386809c6640 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:55.999664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b0d5-ccbb-494b-9468-6386809c6640 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:55.999942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b0d5-ccbb-494b-9468-6386809c6640 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.000591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b0d5-ccbb-494b-9468-6386809c6640 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.001998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b0d5-ccbb-494b-9468-6386809c6640 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.019103 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:56.059123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1aa3f-db7a-4dd3-a3e2-29b58a9fa911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.060755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1aa3f-db7a-4dd3-a3e2-29b58a9fa911 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.110014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 373/738] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:16:55 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:56.111021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b0d5-ccbb-494b-9468-6386809c6640 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.159068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:56.168542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 366/739] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:16:56.171140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c99f-1c26-472e-a4f5-18e80d07b164 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.171140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c99f-1c26-472e-a4f5-18e80d07b164 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.171140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c99f-1c26-472e-a4f5-18e80d07b164 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.172352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 367/740] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:56.173002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c99f-1c26-472e-a4f5-18e80d07b164 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.239772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b0d5-ccbb-494b-9468-6386809c6640 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:56.241457 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:56.283251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:56.283914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.284243 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.284586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.285512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:56.286020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.287430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.287751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c99f-1c26-472e-a4f5-18e80d07b164 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:56.297147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 374/741] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:56.298491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.328354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f022c-c81a-4851-ac0b-a00d6b33ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:56.328968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f022c-c81a-4851-ac0b-a00d6b33ddbf None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.329253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f022c-c81a-4851-ac0b-a00d6b33ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.329530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f022c-c81a-4851-ac0b-a00d6b33ddbf None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.330205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f022c-c81a-4851-ac0b-a00d6b33ddbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:56.330508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f022c-c81a-4851-ac0b-a00d6b33ddbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.332097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f022c-c81a-4851-ac0b-a00d6b33ddbf None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.349811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 368/742] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:56.349811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7624-7aa5-4146-a326-582cb23d9b22 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.349811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7624-7aa5-4146-a326-582cb23d9b22 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.349811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7624-7aa5-4146-a326-582cb23d9b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.366746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-86dd7624-7aa5-4146-a326-582cb23d9b22 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:56.367962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-86dd7624-7aa5-4146-a326-582cb23d9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:56.404607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:56.408407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf99ef-d1d2-4fb4-8be4-74bd1c9a2690 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:56.442398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 369/743] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:16:56.443261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd7624-7aa5-4146-a326-582cb23d9b22 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.443892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:56.444754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.445240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.445802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.463922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.465399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:56.480414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:56.481436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:56.482452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:56.482452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:56.482452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:56.486027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 375/744] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:56.486904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.511093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:56.565562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd7624-7aa5-4146-a326-582cb23d9b22 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:56.603730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0d974-576d-428b-9053-44ccc61e06e6 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:56.605196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:56.606070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.606556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.606899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.617825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.619896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:56.635564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:56.636536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:56.637936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:56.637936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:56.637936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:56.637936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 370/745] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:56.638944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.648947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:56.649867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.650762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.651213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.660268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.661957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:56.673442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:56.674683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:16:56.675823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:56.680570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 376/746] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:56.682057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.703205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:56.763005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695cd48-92a8-4da1-86e9-c9f2e7419ef6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:56.764582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:56.800355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:56.800965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.801245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.801518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.801819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a02716-c878-469f-9806-a878b3a1f76b None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:56.802254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:56.802480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.803847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.815504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 371/747] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:56.816385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.844680 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:56.845284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.845709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.845988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.846749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:56.847050 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.848418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.865254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 377/748] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:56.866223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:56.918256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e47b-96ce-4eb4-a21f-91d9a7b2136a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:56.962941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:56.963583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:56.963878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:56.964086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:56.965339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:56.965339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:56.966566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:56.989774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 372/749] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:56.989774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.006820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:57.011438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:57.041392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6721548-9ee7-4901-9b51-4b729695ca4c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.080482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a245c-97bf-46eb-b807-9bed2c6a99aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.081095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a245c-97bf-46eb-b807-9bed2c6a99aa None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.081376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a245c-97bf-46eb-b807-9bed2c6a99aa None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.081678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a245c-97bf-46eb-b807-9bed2c6a99aa None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.082326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a245c-97bf-46eb-b807-9bed2c6a99aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.083691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a245c-97bf-46eb-b807-9bed2c6a99aa None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.098219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28338a5-1d2c-4919-b17a-6822c6423027 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.133083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.133743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.134052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.134327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.140858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.142328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.150987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 378/750] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:16:56 2022] POST /identity/v3/services => generated 240 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:57.151832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a245c-97bf-46eb-b807-9bed2c6a99aa None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:57.158743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:57.164867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 373/751] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:57.166439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.273693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:57.299171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a0584-cf79-4ad7-a2c8-e8193ff8f623 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.306446 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a245c-97bf-46eb-b807-9bed2c6a99aa None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.340576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:57.340943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.341584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.341907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.342181 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.353630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.355008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.356548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.357380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.357999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.358290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.366937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.368546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:57.371246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:57.372308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:57.373213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:57.373213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:57.373213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:57.373213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 374/752] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:57.377429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:16:57.387077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:57.388067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:16:57.389152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:57.395647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 379/753] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:57.396512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.505362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801e096-c203-42b5-9f11-5ded34a0e869 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.514244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df85ebb-558c-4862-92c8-ba5dd9e6f529 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.544813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.545423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.545734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.546009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.546713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:57.547016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.548614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.556065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:57.562224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.563090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.563567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.564057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.564949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:57.565253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 380/754] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:57.565638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.566244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.573935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.584897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 375/755] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:57.586281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.621219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:57.682536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b7929-4fbb-4fdf-8361-dd5a473e117e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.718576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3c46-a668-4a8f-a5fa-065c7b2c3621 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.725956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.726573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.726859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.727139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.728061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:57.728375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.730355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.750243 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 381/756] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:57.751428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.761531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.762209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.762491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.762767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.770374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.771945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:57.784803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:57.785728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:57.786631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 376/757] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:57.787119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.845675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:57.858983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f312d8e-65d2-4563-bc1f-233fed7b6950 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.867739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:57.895781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.896551 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.896860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cf253-5c0c-4b1a-8e83-47e9192bd193 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:57.896983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.897358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:57.898214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=8442dc046cb64619b62823b8bcc7cc4b) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:57.898668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:57.901026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:57.913651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 382/758] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/role_assignments?user.id=8442dc046cb64619b62823b8bcc7cc4b&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:57.913651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:57.967174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b8651-b511-4e4e-a922-fba9887615d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:57.968395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8651-b511-4e4e-a922-fba9887615d8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:57.968837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8651-b511-4e4e-a922-fba9887615d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:57.969255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8651-b511-4e4e-a922-fba9887615d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.057598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33484-d605-4dcb-8145-4815fb364fbb None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:58.117196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebb77a-896f-42ba-b368-09bcf3fb6f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:58.117389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b8651-b511-4e4e-a922-fba9887615d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:58.117775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb77a-896f-42ba-b368-09bcf3fb6f98 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:58.118053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb77a-896f-42ba-b368-09bcf3fb6f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:58.118328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb77a-896f-42ba-b368-09bcf3fb6f98 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.119292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b8651-b511-4e4e-a922-fba9887615d8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:58.119571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebb77a-896f-42ba-b368-09bcf3fb6f98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:58.119876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebb77a-896f-42ba-b368-09bcf3fb6f98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:58.121382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebb77a-896f-42ba-b368-09bcf3fb6f98 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:58.135214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 383/759] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:58.136531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939794-15e3-404b-a3a9-92f73b27f650 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:58.136824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939794-15e3-404b-a3a9-92f73b27f650 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:58.137097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939794-15e3-404b-a3a9-92f73b27f650 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.142726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 384/760] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:58.143505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85939794-15e3-404b-a3a9-92f73b27f650 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:58.176935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:58.180436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:58.238717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 377/761] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:16:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:16:58.242049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c704-73e6-44a3-b2e8-2d67cc2a94e4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:58.242342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c704-73e6-44a3-b2e8-2d67cc2a94e4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:58.242622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c704-73e6-44a3-b2e8-2d67cc2a94e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.262244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a056c704-73e6-44a3-b2e8-2d67cc2a94e4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:58.263513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a056c704-73e6-44a3-b2e8-2d67cc2a94e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:58.265178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85939794-15e3-404b-a3a9-92f73b27f650 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:58.300375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dbca6-9709-4cdf-ba79-a8ebd3176fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:58.301031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dbca6-9709-4cdf-ba79-a8ebd3176fca None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:58.301310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dbca6-9709-4cdf-ba79-a8ebd3176fca None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:58.301583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dbca6-9709-4cdf-ba79-a8ebd3176fca None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/33ac116b19864bd694ca089dd5f7e010/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.303652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dbca6-9709-4cdf-ba79-a8ebd3176fca None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=33ac116b19864bd694ca089dd5f7e010, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:58.305134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dbca6-9709-4cdf-ba79-a8ebd3176fca None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:58.336303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 378/762] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:16:58.337222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056c704-73e6-44a3-b2e8-2d67cc2a94e4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:58.386859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 385/763] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:16:58 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/33ac116b19864bd694ca089dd5f7e010/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:16:58.476810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:58.502709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056c704-73e6-44a3-b2e8-2d67cc2a94e4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:58.540829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:58.541472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:58.541783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:58.542052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.552639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:58.554118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:16:58.569620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:58.570610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:16:58.571744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:16:58.571744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:16:58.571744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:58.571744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 379/764] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:58.578001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dbca6-9709-4cdf-ba79-a8ebd3176fca None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:58.679087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:58.681949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:58.699654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dbca6-9709-4cdf-ba79-a8ebd3176fca None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:58.768346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:58.773707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:58.773707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:58.773707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.773707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:58.773707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:58.773707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:58.798313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 386/765] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:58.799772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:58.907315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ada4be-01cf-483e-99c8-5daa2cc59216 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:58.916478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b514f-d06c-47e5-a4e8-7697b630fd9e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:58.953383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:58.953849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:58.954136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:58.954411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.961833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:58.963920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:58.969643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:58.970858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:58.971344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:58.971819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:58.972680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:58.974298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:16:58.976065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:58.976966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:16:58.978864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 387/766] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:16:58.983688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:16:58.988728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:16:58.989764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:16:58.990632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:16:58.993470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 380/767] 10.222.0.61 () {56 vars in 1129 bytes} [Tue Aug 23 16:16:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:16:58.997814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:58.999000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:59.016699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:59.172073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65983673-22b7-4189-b1b3-a54aee57c040 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:59.179768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085de8a2-695f-459b-8ffc-58d4128edac3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:59.240493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:59.241986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:59.242903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:59.243720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:59.245143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:59.246002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:59.246808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:59.247317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:59.247834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:59.248305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:59.249910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:59.250818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:59.251351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:59.252968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:59.261261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 381/768] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Aug 23 16:16:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:59.266579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:59.271997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 388/769] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:59.278114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:59.338214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:59.372052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3762f16-4cda-45ae-97ba-c4a5bea8e20e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:59.408400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43d4e5-37f6-48b5-85e1-6c90467ca96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:59.409160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d4e5-37f6-48b5-85e1-6c90467ca96d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:59.409444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d4e5-37f6-48b5-85e1-6c90467ca96d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:59.409831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d4e5-37f6-48b5-85e1-6c90467ca96d None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:59.410463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43d4e5-37f6-48b5-85e1-6c90467ca96d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:59.410766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43d4e5-37f6-48b5-85e1-6c90467ca96d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:59.412139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43d4e5-37f6-48b5-85e1-6c90467ca96d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:59.417827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:59.418262 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 382/770] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Aug 23 16:16:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:16:59.420277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307329-0c31-4e55-ac8a-512dcb4789c8 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:59.420717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307329-0c31-4e55-ac8a-512dcb4789c8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:59.421142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307329-0c31-4e55-ac8a-512dcb4789c8 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:59.422762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 383/771] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:16:59.430899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182b6f-2d81-4e2f-a9f1-2f28a2bb5683 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:59.431709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182b6f-2d81-4e2f-a9f1-2f28a2bb5683 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:59.431985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62182b6f-2d81-4e2f-a9f1-2f28a2bb5683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:59.454772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-62182b6f-2d81-4e2f-a9f1-2f28a2bb5683 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:16:59.455958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eda25-fabf-4929-be63-46e363871fb4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:59.456145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-62182b6f-2d81-4e2f-a9f1-2f28a2bb5683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:16:59.498161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:59.499520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:59.500006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:59.500495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:59.501764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=cc5ff4a4b258472d90e7e9efd94d8808) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:59.502562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:59.504459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:59.522055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 389/772] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:16:59 2022] GET /identity/v3/role_assignments?user.id=cc5ff4a4b258472d90e7e9efd94d8808&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:59.523177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:59.532364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 384/773] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:16:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:16:59.688741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0e8c-50aa-4888-91b4-dd012d7fcb38 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:59.730514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:59.731133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:59.731411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:59.731678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:59.732392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] RBAC: Adding query filter params (interface=public, service_id=cbc929bd76904d6fabe398e2866f2261, region_id=RegionOne) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:16:59.732696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:59.734098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:59.736018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:59.742753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 390/774] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Aug 23 16:16:59 2022] GET /identity/v3/endpoints?service_id=cbc929bd76904d6fabe398e2866f2261&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:16:59.751747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62182b6f-2d81-4e2f-a9f1-2f28a2bb5683 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:59.810303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:59.867746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62182b6f-2d81-4e2f-a9f1-2f28a2bb5683 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:16:59.876419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:16:59.932010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f87d2-e503-4432-8d64-58b1a7e586f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:16:59.933349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f87d2-e503-4432-8d64-58b1a7e586f7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:16:59.934547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f87d2-e503-4432-8d64-58b1a7e586f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:16:59.935006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f87d2-e503-4432-8d64-58b1a7e586f7 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:16:59.937879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f87d2-e503-4432-8d64-58b1a7e586f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:16:59.939483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f87d2-e503-4432-8d64-58b1a7e586f7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:16:59.952984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 385/775] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:16:59 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:00.052816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a821319-e95b-4615-8a85-fa86ebeaf23c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:00.094274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38105d20-07c6-450a-8edf-4bd37d45d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:00.095445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105d20-07c6-450a-8edf-4bd37d45d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.096007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105d20-07c6-450a-8edf-4bd37d45d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.096483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38105d20-07c6-450a-8edf-4bd37d45d0a1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.097278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105d20-07c6-450a-8edf-4bd37d45d0a1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:00.098995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38105d20-07c6-450a-8edf-4bd37d45d0a1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-38105d20-07c6-450a-8edf-4bd37d45d0a1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:00.108825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:00.109953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:17:00.110824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:00.114106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 391/776] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:16:59 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:00.123080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f87d2-e503-4432-8d64-58b1a7e586f7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:00.229699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7063d8-0c22-44e2-b2d8-ea6033f4edd3 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.230428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7063d8-0c22-44e2-b2d8-ea6033f4edd3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.230913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7063d8-0c22-44e2-b2d8-ea6033f4edd3 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.232693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 392/777] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:00.235689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f87d2-e503-4432-8d64-58b1a7e586f7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:00.238882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d11e-6681-4ed2-a78c-dad2235a5cd3 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.239416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d11e-6681-4ed2-a78c-dad2235a5cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.239900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d11e-6681-4ed2-a78c-dad2235a5cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.259998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-cbb3d11e-6681-4ed2-a78c-dad2235a5cd3 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:00.261205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cbb3d11e-6681-4ed2-a78c-dad2235a5cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:00.270009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:00.278303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:00.279215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.279691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.280169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.280997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] RBAC: Adding query filter params (name=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:00.281524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:00.283197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:00.288134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 386/778] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:00.299734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:00.335630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:00.347278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 393/779] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:00.418039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdd2b-708a-458b-81c2-ffaad0514915 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:00.459236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:00.459841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.460116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.460386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.461015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] RBAC: Adding query filter params (type=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:00.461314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:00.462848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:00.468418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 387/780] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:00.474119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3d11e-6681-4ed2-a78c-dad2235a5cd3 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:00.602022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3d11e-6681-4ed2-a78c-dad2235a5cd3 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:00.654357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9df14-e77e-433b-a182-395e85ebdc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:00.654970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9df14-e77e-433b-a182-395e85ebdc36 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.655249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9df14-e77e-433b-a182-395e85ebdc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.655519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9df14-e77e-433b-a182-395e85ebdc36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.656220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9df14-e77e-433b-a182-395e85ebdc36 None admin] RBAC: Adding query filter params (interface=public, service_id=91a620e802b447a4bc1827cbf13481e7, region_id=RegionOne) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:00.656524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9df14-e77e-433b-a182-395e85ebdc36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:00.657916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9df14-e77e-433b-a182-395e85ebdc36 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:00.666291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 394/781] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Aug 23 16:17:00 2022] GET /identity/v3/endpoints?service_id=91a620e802b447a4bc1827cbf13481e7&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:00.671439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:00.734661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:00.760641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4cc35-401e-4b80-a1e7-c4d459601159 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.760925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4cc35-401e-4b80-a1e7-c4d459601159 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.761198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4cc35-401e-4b80-a1e7-c4d459601159 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.763903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 395/782] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:00.768894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bef7-3310-45e4-baea-8826bb508e02 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.769174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bef7-3310-45e4-baea-8826bb508e02 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.769448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277bef7-3310-45e4-baea-8826bb508e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.789224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-5277bef7-3310-45e4-baea-8826bb508e02 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:00.791085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5277bef7-3310-45e4-baea-8826bb508e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:00.808056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60c87-0fd3-4a88-b2ff-05395cd13d9d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:00.854685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:00.858436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1ad82-7331-4e1d-b7d4-cb47acd27303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:00.859123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ad82-7331-4e1d-b7d4-cb47acd27303 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:00.859730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ad82-7331-4e1d-b7d4-cb47acd27303 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:00.859842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ad82-7331-4e1d-b7d4-cb47acd27303 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:00.860499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1ad82-7331-4e1d-b7d4-cb47acd27303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:00.862000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1ad82-7331-4e1d-b7d4-cb47acd27303 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:00.868280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 388/783] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:17:00 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:00.869577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1ad82-7331-4e1d-b7d4-cb47acd27303 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:00.883893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 396/784] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:00.983586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1ad82-7331-4e1d-b7d4-cb47acd27303 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:00.998018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:01.020311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3491ff-3236-46b6-8298-de1c3591e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:01.020944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3491ff-3236-46b6-8298-de1c3591e130 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.021226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3491ff-3236-46b6-8298-de1c3591e130 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.021499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3491ff-3236-46b6-8298-de1c3591e130 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.033736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3491ff-3236-46b6-8298-de1c3591e130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-df3491ff-3236-46b6-8298-de1c3591e130 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:01.038489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:01.039427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:01.040877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:01.045143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 389/785] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:01.046652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277bef7-3310-45e4-baea-8826bb508e02 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.195741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277bef7-3310-45e4-baea-8826bb508e02 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:01.233109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3491ff-3236-46b6-8298-de1c3591e130 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.235195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:01.235828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.236112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.236387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.237060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:01.237368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:01.239073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:01.251744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 397/786] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:01.259311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.331991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:01.367242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3491ff-3236-46b6-8298-de1c3591e130 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:01.403754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57e404-2ff3-43aa-a527-85efd5c6f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:01.404387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57e404-2ff3-43aa-a527-85efd5c6f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.404666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57e404-2ff3-43aa-a527-85efd5c6f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.404936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57e404-2ff3-43aa-a527-85efd5c6f0b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.422173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fa4a2-7650-4de3-ba5f-dc113dfedd96 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:01.423781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57e404-2ff3-43aa-a527-85efd5c6f0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-bc57e404-2ff3-43aa-a527-85efd5c6f0b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:01.440726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:01.441753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:01.442604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:01.443237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 390/787] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:01.448216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57e404-2ff3-43aa-a527-85efd5c6f0b3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.463047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:01.464105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.464584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.465052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.476689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:01.478585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:01.493781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:01.494787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:01.495690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:01.495690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:01.495690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:01.497805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 398/788] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:01.503061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.503658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:01.610733 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:01.614231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57e404-2ff3-43aa-a527-85efd5c6f0b3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:01.615180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7534ba-4f1d-4920-ae0e-0c15fac5e149 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:01.662416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:01.663036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.663320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.663592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.664267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:01.664568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:01.667899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:01.678210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:01.678832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.679117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.679391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.680047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:01.680351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:01.683485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:01.685844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 391/789] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:01.691146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.708119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 399/790] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:01.713495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.823123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680db77-0203-4e59-b4a9-ae117e117900 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:01.823123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:01.831525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7a055-a239-42f1-a3e2-c41c4f2d2563 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:01.854185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf7930-1498-456e-8236-2b7cfd4e4976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:01.854816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7930-1498-456e-8236-2b7cfd4e4976 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.855089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7930-1498-456e-8236-2b7cfd4e4976 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.855358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf7930-1498-456e-8236-2b7cfd4e4976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.867041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:01.867264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf7930-1498-456e-8236-2b7cfd4e4976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:01.867671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.867953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.868224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.869288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf7930-1498-456e-8236-2b7cfd4e4976 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:01.876908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:01.878442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-fbcf7930-1498-456e-8236-2b7cfd4e4976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:01.883615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:01.886898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:01.888906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:01.888906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:01.888906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:01.891655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 392/791] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:01.891834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:01.893701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:17:01.895748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:01.896849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f64f-832a-4fab-a79b-4f15edb5f885 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:01.896849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f64f-832a-4fab-a79b-4f15edb5f885 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:01.896849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f64f-832a-4fab-a79b-4f15edb5f885 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:01.902939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 400/792] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:01.903119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 393/793] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:01.903241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.903481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3f64f-832a-4fab-a79b-4f15edb5f885 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:01.916745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:01.999598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275b163-963e-4d6a-b7ff-98b7c55ce657 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.006973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3f64f-832a-4fab-a79b-4f15edb5f885 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.036448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8810a-aa4d-4917-a121-1b239b47cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.036979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8810a-aa4d-4917-a121-1b239b47cab8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.037262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8810a-aa4d-4917-a121-1b239b47cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.037538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8810a-aa4d-4917-a121-1b239b47cab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.039303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8810a-aa4d-4917-a121-1b239b47cab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:02.039610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8810a-aa4d-4917-a121-1b239b47cab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:02.041525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8810a-aa4d-4917-a121-1b239b47cab8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:02.053037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.054039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.054520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.059757 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 401/794] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:02.059757 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9d63-fb01-4322-b4c0-77bef21b9d0e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.059757 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9d63-fb01-4322-b4c0-77bef21b9d0e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.059757 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9d63-fb01-4322-b4c0-77bef21b9d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.060752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.061682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:02.062066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:02.063738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:02.080015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b5bb9d63-fb01-4322-b4c0-77bef21b9d0e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:02.081483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b5bb9d63-fb01-4322-b4c0-77bef21b9d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:02.087313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 394/795] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Aug 23 16:17:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:02.088304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:02.092163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.155762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 402/796] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:02.157000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb9d63-fb01-4322-b4c0-77bef21b9d0e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:02.169710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.229548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd640a7c-9764-469d-b0f5-1205fa872b3b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.264169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb9d63-fb01-4322-b4c0-77bef21b9d0e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.299560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.300347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.300912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.301287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.312832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:02.314675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:02.331494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:02.332671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:02.333586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:02.333586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:02.333586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:02.334088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 403/797] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:02.338312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.338997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.339239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.339508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.340502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:02.362387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:02.364150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:02.393461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:02.394499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:02.396121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 395/798] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:17:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:02.400607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:02.413986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.452844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06429b-294e-4fa6-ad32-de5eb694c3fd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.510097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.521279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.521858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.522145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.522467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.523122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:02.523426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:02.525338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:02.544821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 404/799] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:02.549346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:02.549554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfbfd5-4b8d-4798-a9d9-e1687def92b2 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.585529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf602d31-4abc-4fef-9db4-f7f1533f1650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.586179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602d31-4abc-4fef-9db4-f7f1533f1650 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.586566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602d31-4abc-4fef-9db4-f7f1533f1650 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.586759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf602d31-4abc-4fef-9db4-f7f1533f1650 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.587989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf602d31-4abc-4fef-9db4-f7f1533f1650 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:02.588293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf602d31-4abc-4fef-9db4-f7f1533f1650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:02.589743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf602d31-4abc-4fef-9db4-f7f1533f1650 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:02.608990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 396/800] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:17:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:02.608990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551b2a-7f00-4e06-a922-da5787bc0e30 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.609490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551b2a-7f00-4e06-a922-da5787bc0e30 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.609598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551b2a-7f00-4e06-a922-da5787bc0e30 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.613992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 397/801] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:02.614586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551b2a-7f00-4e06-a922-da5787bc0e30 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:02.669864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a82e2c-4d18-477a-82f8-406bbf04e5fe None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.693355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.706779 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab51ef-2ffb-4d93-954b-095e1767613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.707416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab51ef-2ffb-4d93-954b-095e1767613e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.707697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab51ef-2ffb-4d93-954b-095e1767613e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.707968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab51ef-2ffb-4d93-954b-095e1767613e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.719149 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab51ef-2ffb-4d93-954b-095e1767613e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:02.719384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551b2a-7f00-4e06-a922-da5787bc0e30 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-efab51ef-2ffb-4d93-954b-095e1767613e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:02.723929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:02.724875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 405/802] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:02.730758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab51ef-2ffb-4d93-954b-095e1767613e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:02.747936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.760579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0f2e-f65a-47f6-9f75-ebdb3ee2a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.761205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0f2e-f65a-47f6-9f75-ebdb3ee2a53a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.762802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0f2e-f65a-47f6-9f75-ebdb3ee2a53a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.762802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0f2e-f65a-47f6-9f75-ebdb3ee2a53a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.768254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f0f2e-f65a-47f6-9f75-ebdb3ee2a53a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:02.769722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f0f2e-f65a-47f6-9f75-ebdb3ee2a53a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-540f0f2e-f65a-47f6-9f75-ebdb3ee2a53a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:02.782017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:02.783227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 398/803] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:02.784290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612936bd-5c0c-4aec-9055-5eb7cfac384a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.784839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612936bd-5c0c-4aec-9055-5eb7cfac384a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.784839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612936bd-5c0c-4aec-9055-5eb7cfac384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.802784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-612936bd-5c0c-4aec-9055-5eb7cfac384a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:02.803956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-612936bd-5c0c-4aec-9055-5eb7cfac384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:02.843315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab51ef-2ffb-4d93-954b-095e1767613e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.873741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 399/804] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:02.874589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612936bd-5c0c-4aec-9055-5eb7cfac384a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:02.902101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d175e-6127-427f-a831-f22d8ce6914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:02.903389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d175e-6127-427f-a831-f22d8ce6914a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.904163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d175e-6127-427f-a831-f22d8ce6914a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.905059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d175e-6127-427f-a831-f22d8ce6914a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.972534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.981888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612936bd-5c0c-4aec-9055-5eb7cfac384a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:02.995966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d175e-6127-427f-a831-f22d8ce6914a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:02.997533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d175e-6127-427f-a831-f22d8ce6914a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:02.997894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.026273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.027624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.028336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.028792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.029814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:03.030304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.037023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.047553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 400/805] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:03.047553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.127632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 406/806] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:17:03.129150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d175e-6127-427f-a831-f22d8ce6914a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.162771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4484603-56d2-4f17-addc-b230cad5c6ba None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.203223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.203972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.204353 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.204725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.205521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:03.205849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.207282 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.214492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.219268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 401/807] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:03.220189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.232749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d175e-6127-427f-a831-f22d8ce6914a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.254450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.267363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.268005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.268286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.271599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.278485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.279941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:03.294141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:03.295161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:03.296803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:03.296803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:03.296803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:03.296803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 407/808] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:03.296803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.320452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4bfb1-5ae1-47ac-aa14-830bd3ccf13e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.354011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce96cdf-81f4-40f6-af5f-ab8d5cfbef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.354981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96cdf-81f4-40f6-af5f-ab8d5cfbef6b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.354981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96cdf-81f4-40f6-af5f-ab8d5cfbef6b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.355262 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce96cdf-81f4-40f6-af5f-ab8d5cfbef6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.365454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce96cdf-81f4-40f6-af5f-ab8d5cfbef6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.366922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce96cdf-81f4-40f6-af5f-ab8d5cfbef6b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dce96cdf-81f4-40f6-af5f-ab8d5cfbef6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:03.381550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:03.382725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:03.383627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:03.383627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:03.383627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:03.383627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 402/809] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:03.383948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d688e-0ad0-4842-89fe-0bef0776f602 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.384836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d688e-0ad0-4842-89fe-0bef0776f602 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.385112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d688e-0ad0-4842-89fe-0bef0776f602 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.386350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 403/810] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:03.387030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d688e-0ad0-4842-89fe-0bef0776f602 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.401175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4167eb-ff6e-4c3e-a0ad-b055cf629456 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.435296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.435930 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.436213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.436491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.437077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.438496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.440232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:03.448003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:03.457442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:03.458566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 408/811] 10.222.0.61 () {56 vars in 1129 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:03.459554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.473575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.488900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d688e-0ad0-4842-89fe-0bef0776f602 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.557961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbacbc-61c0-405c-8960-fafd2ca23be1 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.593686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.594283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.594563 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.594833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.595483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:03.595781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.597157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.609315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 409/812] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:03.610191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.637337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8b8c4-4377-4f42-b0e9-28fa2eba8bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.638019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8b8c4-4377-4f42-b0e9-28fa2eba8bcd None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.638296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8b8c4-4377-4f42-b0e9-28fa2eba8bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.638581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8b8c4-4377-4f42-b0e9-28fa2eba8bcd None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/8442dc046cb64619b62823b8bcc7cc4b/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.640439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8b8c4-4377-4f42-b0e9-28fa2eba8bcd None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=8442dc046cb64619b62823b8bcc7cc4b, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.641895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8b8c4-4377-4f42-b0e9-28fa2eba8bcd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.668217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.708273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa8036-70c2-49ec-909d-d4a85dbf329e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.726748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 404/813] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:17:03 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/8442dc046cb64619b62823b8bcc7cc4b/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:17:03.728440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76129-91da-49ad-a547-ffe91c62112f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.728723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76129-91da-49ad-a547-ffe91c62112f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.728998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c76129-91da-49ad-a547-ffe91c62112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.743230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.744424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.744715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.744993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.745697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:03.746007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.747439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.749307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-23c76129-91da-49ad-a547-ffe91c62112f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:03.750567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-23c76129-91da-49ad-a547-ffe91c62112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:03.761686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 410/814] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:03.762592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.834179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 405/815] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:03.834179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c76129-91da-49ad-a547-ffe91c62112f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.893055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a6141-104b-4bbb-accc-ea01e9428173 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.912995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.930810 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.931491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.931778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.932057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.932693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:03.933029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.934444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.939272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 411/816] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:03.940088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.942910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.971269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c76129-91da-49ad-a547-ffe91c62112f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.009680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.010797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.011301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.011885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.019723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.022018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:04.034899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:04.035899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:04.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 406/817] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:04.037493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.061196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a4c7d-5d7d-46d2-9be7-efba65610bcc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.108492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.109462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.109853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.110202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.119994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.122440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:04.137339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:04.138321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 412/818] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:04.139608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.154791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192b7cf-ef6d-4822-9c98-94c3281b7c27 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.189517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:04.191507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538708-a283-4938-b39e-268c01458953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.192114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538708-a283-4938-b39e-268c01458953 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.192389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538708-a283-4938-b39e-268c01458953 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.192665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538708-a283-4938-b39e-268c01458953 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.193328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64538708-a283-4938-b39e-268c01458953 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:04.193601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64538708-a283-4938-b39e-268c01458953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.195001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64538708-a283-4938-b39e-268c01458953 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.197165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:04.204725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 407/819] 10.222.0.61 () {56 vars in 1124 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:04.204725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538708-a283-4938-b39e-268c01458953 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.259944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f271e-9029-48ef-855d-e0e876ede476 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.295268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.296189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.296479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.296906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.297659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:04.297975 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.299404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.305134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538708-a283-4938-b39e-268c01458953 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.316858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 413/820] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:04.317726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.345661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.346682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.347149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.347605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] PATH_INFO: `/v3/services/network` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.348491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.350180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:04.359368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:04.361055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:17:04.362153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:04.369263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 408/821] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:04.370340 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.419023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:04.421968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95f5b1-562a-49a2-8092-113bb4a6561d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.439125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:04.459268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.459979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.460309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.460584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.461316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:04.461632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.463781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.475837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 414/822] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:04.476445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.493054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601ec16-bbf9-4a0b-bb3d-daa9c7ff33fe None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.528502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55400f9-778a-4d4b-a77b-6f103d533865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.529107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55400f9-778a-4d4b-a77b-6f103d533865 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.529384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55400f9-778a-4d4b-a77b-6f103d533865 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.529685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55400f9-778a-4d4b-a77b-6f103d533865 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.530344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55400f9-778a-4d4b-a77b-6f103d533865 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.531709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55400f9-778a-4d4b-a77b-6f103d533865 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.577010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98863325-ae77-41d1-b0dd-be5fa6ce1d48 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.609889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.610497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.610779 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.611049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.622275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.623795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.633882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 409/823] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:17:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:04.633882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55400f9-778a-4d4b-a77b-6f103d533865 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:04.653978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:04.655002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:04.655905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:04.655905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:04.655905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:04.660945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 415/824] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:04.661970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.693036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:04.782027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55400f9-778a-4d4b-a77b-6f103d533865 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.799412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc788-e709-47f8-8055-4858660220cf None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:04.810125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:04.838111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.838761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.839043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.839316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.839957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] RBAC: Adding query filter params (name=network) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:04.840268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.843110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.848993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 410/825] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:04.854606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.858217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:04.859182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:04.859695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:04.860171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:04.861061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=33ac116b19864bd694ca089dd5f7e010) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:04.861518 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:04.863522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:04.870770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 416/826] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/role_assignments?user.id=33ac116b19864bd694ca089dd5f7e010&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:04.871737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:04.973125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:04.997517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff35cd4-a432-480c-856a-e7a6aa75e547 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:05.006553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39c0d6-3803-4c6f-a5e6-e3fb0904880a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:05.041628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:05.042497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.042925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.043405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.044324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:05.044891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:05.046505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:05.065211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:05.065211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.065211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.065211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.065541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] RBAC: Adding query filter params (type=network) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:05.065541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:05.065541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:05.070953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 417/827] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:05.078148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 411/828] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:05.078958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:05.085028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:05.141707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:05.209789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cd230-5d9f-4f79-a656-80283e443d0f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:05.210477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603c1b6-b9e9-415f-a510-4248c13f1237 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:05.248042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd11cdf-2bd4-40cf-b164-3ad0a1bd8469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:05.248652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd11cdf-2bd4-40cf-b164-3ad0a1bd8469 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.248935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd11cdf-2bd4-40cf-b164-3ad0a1bd8469 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.249207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd11cdf-2bd4-40cf-b164-3ad0a1bd8469 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.249921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd11cdf-2bd4-40cf-b164-3ad0a1bd8469 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:05.251306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd11cdf-2bd4-40cf-b164-3ad0a1bd8469 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:05.255911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:05.257367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.257848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.258697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.263420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:05.270095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:05.271795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:05.285737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:05.286694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:05.287695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 412/829] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:05.293047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:05.339213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 418/830] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:17:05 2022] POST /identity/v3/endpoints => generated 337 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:05.413732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:05.416540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e20f1-04a7-4604-917d-4f0a085739e0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:05.462915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15fe7-34bf-4005-9d0d-161f222ad0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:05.463539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15fe7-34bf-4005-9d0d-161f222ad0ea None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.463816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15fe7-34bf-4005-9d0d-161f222ad0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.464086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15fe7-34bf-4005-9d0d-161f222ad0ea None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.464791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15fe7-34bf-4005-9d0d-161f222ad0ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:05.465088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15fe7-34bf-4005-9d0d-161f222ad0ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:05.466606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15fe7-34bf-4005-9d0d-161f222ad0ea None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:05.480036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 413/831] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:05.486026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd11cdf-2bd4-40cf-b164-3ad0a1bd8469 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:05.609561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd11cdf-2bd4-40cf-b164-3ad0a1bd8469 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:05.650182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69538477-ae06-482f-b407-b4793a2f2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:05.650845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538477-ae06-482f-b407-b4793a2f2a6a None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.651125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538477-ae06-482f-b407-b4793a2f2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.651398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69538477-ae06-482f-b407-b4793a2f2a6a None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/cc5ff4a4b258472d90e7e9efd94d8808/roles/509e1b745fb24a048d7ff490dc477940` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.666285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69538477-ae06-482f-b407-b4793a2f2a6a None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=cc5ff4a4b258472d90e7e9efd94d8808, role_id=509e1b745fb24a048d7ff490dc477940)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:05.667659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69538477-ae06-482f-b407-b4793a2f2a6a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:05.746880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 419/832] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:17:05 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/cc5ff4a4b258472d90e7e9efd94d8808/roles/509e1b745fb24a048d7ff490dc477940 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:17:05.805641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109caf86-932e-47de-a980-a5c93bdce534 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.805641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109caf86-932e-47de-a980-a5c93bdce534 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.805641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109caf86-932e-47de-a980-a5c93bdce534 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.805641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 414/833] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:05.811926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aee51-77ab-4069-9e8b-d0412d7f2efc None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.812287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aee51-77ab-4069-9e8b-d0412d7f2efc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.812633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24aee51-77ab-4069-9e8b-d0412d7f2efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.833240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b24aee51-77ab-4069-9e8b-d0412d7f2efc None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:05.834637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b24aee51-77ab-4069-9e8b-d0412d7f2efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:05.884546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:05.911083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 420/834] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:06.183572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109caf86-932e-47de-a980-a5c93bdce534 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:06.292316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109caf86-932e-47de-a980-a5c93bdce534 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:06.327812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e788367-8b6c-44a9-a4c6-0b80c8b96b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:06.328705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e788367-8b6c-44a9-a4c6-0b80c8b96b2d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:06.329132 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e788367-8b6c-44a9-a4c6-0b80c8b96b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:06.329548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e788367-8b6c-44a9-a4c6-0b80c8b96b2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:06.340631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e788367-8b6c-44a9-a4c6-0b80c8b96b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1e788367-8b6c-44a9-a4c6-0b80c8b96b2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:06.345301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:06.346520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:06.347601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:06.349939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 415/835] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:06.358031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24aee51-77ab-4069-9e8b-d0412d7f2efc None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:06.459855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24aee51-77ab-4069-9e8b-d0412d7f2efc None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:06.495672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:06.496289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:06.496571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:06.496843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:06.497515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:06.497849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:06.499235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:06.513037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 421/836] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:06.518330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e788367-8b6c-44a9-a4c6-0b80c8b96b2d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:06.537167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:06.622167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e788367-8b6c-44a9-a4c6-0b80c8b96b2d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:06.656260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:06.656889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:06.657171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:06.657443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:06.668432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:06.669903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:06.685000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:06.685979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:06.686915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:06.686915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:06.686915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:06.686915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 416/837] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:06.692135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:06.733712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:06.800222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034d452-05a2-45e0-b6ce-1b59ffd9b464 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:06.835639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f14ac-55c1-4cda-8dcc-8ded604cba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:06.836246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f14ac-55c1-4cda-8dcc-8ded604cba34 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:06.836525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f14ac-55c1-4cda-8dcc-8ded604cba34 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:06.836861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f14ac-55c1-4cda-8dcc-8ded604cba34 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:06.837588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f14ac-55c1-4cda-8dcc-8ded604cba34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:06.837917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f14ac-55c1-4cda-8dcc-8ded604cba34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:06.839290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f14ac-55c1-4cda-8dcc-8ded604cba34 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:06.852172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 422/838] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:06.858172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:06.897917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348884c-ae4b-43fb-aaa3-467ae6b39883 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:06.898209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348884c-ae4b-43fb-aaa3-467ae6b39883 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:06.898397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348884c-ae4b-43fb-aaa3-467ae6b39883 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:06.901538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 423/839] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:06.905721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a17b-07f1-4690-b6f9-b11daf984232 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:06.906009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a17b-07f1-4690-b6f9-b11daf984232 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:06.906290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7a17b-07f1-4690-b6f9-b11daf984232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:06.925854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-93d7a17b-07f1-4690-b6f9-b11daf984232 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:06.927157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-93d7a17b-07f1-4690-b6f9-b11daf984232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:06.936516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:06.983854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540fcbc-638b-433e-af26-f2738fc744b7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:07.010948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 424/840] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:07.022777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7e1f0-0a75-4116-86c7-d751107f1f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:07.023407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e1f0-0a75-4116-86c7-d751107f1f53 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.023690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e1f0-0a75-4116-86c7-d751107f1f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.023959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e1f0-0a75-4116-86c7-d751107f1f53 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.032131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7e1f0-0a75-4116-86c7-d751107f1f53 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:07.033572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7e1f0-0a75-4116-86c7-d751107f1f53 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-83c7e1f0-0a75-4116-86c7-d751107f1f53 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:07.045022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:07.046541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:07.047735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 417/841] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:17:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:07.052618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7a17b-07f1-4690-b6f9-b11daf984232 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.082240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:07.157110 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7a17b-07f1-4690-b6f9-b11daf984232 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:07.192085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:07.192699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.192980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.193249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.194010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:07.194313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:07.195746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:07.206908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffc28-4a70-4e03-ac4d-c8313c1ab42c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.207194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffc28-4a70-4e03-ac4d-c8313c1ab42c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.207466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffc28-4a70-4e03-ac4d-c8313c1ab42c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.208923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 418/842] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:07.214656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031a84-9823-432e-aa3f-fda2341e4c2b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.215176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031a84-9823-432e-aa3f-fda2341e4c2b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.215663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa031a84-9823-432e-aa3f-fda2341e4c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.217573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 425/843] 10.222.0.61 () {56 vars in 1135 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:07.222986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.237912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-aa031a84-9823-432e-aa3f-fda2341e4c2b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:07.239645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aa031a84-9823-432e-aa3f-fda2341e4c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:07.314093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 419/844] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:07.314093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa031a84-9823-432e-aa3f-fda2341e4c2b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.327022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:07.346565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1ac2e-f98d-4684-81a1-168c8f196e64 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:07.387782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:07.396530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5fa0-de24-4d52-a858-3f5214b2a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:07.397150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5fa0-de24-4d52-a858-3f5214b2a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.397583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5fa0-de24-4d52-a858-3f5214b2a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.397896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a5fa0-de24-4d52-a858-3f5214b2a8e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.443314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa031a84-9823-432e-aa3f-fda2341e4c2b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:07.487004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:07.487900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.488627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.489173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.489933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:07.491537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:07.494059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a5fa0-de24-4d52-a858-3f5214b2a8e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:07.496405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a5fa0-de24-4d52-a858-3f5214b2a8e9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:07.501170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:07.502209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:07.503077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:07.505940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 420/845] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:07.512534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.589170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:07.605592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 426/846] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:17:07.606064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5fa0-de24-4d52-a858-3f5214b2a8e9 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.636379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddf06d-502d-44a5-ada3-203247b2b5fc None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:07.660224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:07.671634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:07.672892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.672892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.672892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.673455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:07.673787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:07.675185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:07.679616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 421/847] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:07.680396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.720188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a5fa0-de24-4d52-a858-3f5214b2a8e9 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:07.759882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:07.760522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.760805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.761079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.761686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:07.763104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:07.772655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:07.773672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:07.775308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 427/848] 10.222.0.61 () {56 vars in 1132 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:07.776153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.802889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4679a5-706a-4d24-b40d-fa46d4a1fd44 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:07.833639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:07.839385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:07.840014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.842200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.842200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.851309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:07.852870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:07.866955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:07.868151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:07.869856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:07.869856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:07.869856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:07.869856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 422/849] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:07.869856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.890078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067c220-2d69-45ee-bcb6-1a53bd32bac2 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:07.909803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:07.924431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bb581-bf0a-4576-9636-f32aade75812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:07.925040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb581-bf0a-4576-9636-f32aade75812 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.925323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb581-bf0a-4576-9636-f32aade75812 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.925598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bb581-bf0a-4576-9636-f32aade75812 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.926250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb581-bf0a-4576-9636-f32aade75812 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:07.926553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb581-bf0a-4576-9636-f32aade75812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:07.927926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bb581-bf0a-4576-9636-f32aade75812 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:07.933086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 428/850] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:07.934187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62b86-a7a9-4dd2-a939-7c8598e31e8b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:07.934474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62b86-a7a9-4dd2-a939-7c8598e31e8b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:07.934748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62b86-a7a9-4dd2-a939-7c8598e31e8b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:07.936133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 429/851] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:07.936845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e62b86-a7a9-4dd2-a939-7c8598e31e8b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:07.978476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274931d-9d80-4d0d-b5a2-da4734345c73 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.021332 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8122a1-17ab-426c-a085-b098490bf9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.021982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8122a1-17ab-426c-a085-b098490bf9ab None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.022523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8122a1-17ab-426c-a085-b098490bf9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.022808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8122a1-17ab-426c-a085-b098490bf9ab None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.025184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8122a1-17ab-426c-a085-b098490bf9ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:08.025499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8122a1-17ab-426c-a085-b098490bf9ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:08.029137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8122a1-17ab-426c-a085-b098490bf9ab None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:08.035493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 423/852] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:08.036863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971d98-f679-4f53-9915-1f4f428b3333 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.037152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971d98-f679-4f53-9915-1f4f428b3333 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.037426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971d98-f679-4f53-9915-1f4f428b3333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.058817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-06971d98-f679-4f53-9915-1f4f428b3333 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:08.060111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-06971d98-f679-4f53-9915-1f4f428b3333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:08.073465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e62b86-a7a9-4dd2-a939-7c8598e31e8b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.092758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:08.120594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.121219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.121944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.122443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.123382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:08.124042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:08.126003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:08.138322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 430/853] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:08.139178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:08.146714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 424/854] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:08.147864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06971d98-f679-4f53-9915-1f4f428b3333 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:08.186707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:08.261734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06971d98-f679-4f53-9915-1f4f428b3333 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.279165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4dc62-07a6-4622-aad7-cf4448f4bbfc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.298877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.299887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.300396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.300875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.309031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:08.310831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:08.321334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.321998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.322276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.322549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.323178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:08.323478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:08.324762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:08.325682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:08.326595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:08.326595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:08.326595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:08.326595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:08.326595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:08.326595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:08.326595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:08.326595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:08.327033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:08.329077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 425/855] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:08.333741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 431/856] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:08.334971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:08.444559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:08.449070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:08.459919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373de47-7f61-4301-833f-e4f552caa248 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.498023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:08.511342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.512381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.512605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.512877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.513585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:08.513919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:08.515358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:08.529266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 426/857] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:08.536142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:08.573517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766944a-3e81-4ce2-9b50-b0c3b6ca3d85 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.612441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e6596-0bb6-4eaa-a3e0-83ef8b115ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.613334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e6596-0bb6-4eaa-a3e0-83ef8b115ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.613639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e6596-0bb6-4eaa-a3e0-83ef8b115ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.613931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e6596-0bb6-4eaa-a3e0-83ef8b115ec0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.624867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e6596-0bb6-4eaa-a3e0-83ef8b115ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-ce2e6596-0bb6-4eaa-a3e0-83ef8b115ec0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:08.629683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:08.630640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:08.631503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 432/858] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:17:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:08.637874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e6596-0bb6-4eaa-a3e0-83ef8b115ec0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:08.661509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf7208-e129-428b-b7a5-41ffe07f0572 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.697521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.698164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.698442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.698710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.699436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=8442dc046cb64619b62823b8bcc7cc4b) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:08.699741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:08.701154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:08.714011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 427/859] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:08 2022] GET /identity/v3/role_assignments?user.id=8442dc046cb64619b62823b8bcc7cc4b&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:08.748029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:08.752216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e6596-0bb6-4eaa-a3e0-83ef8b115ec0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.793119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.793684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.793972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.794311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.794996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:08.795348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:08.796834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:08.807128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 433/860] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:17:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:08.812392 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:08.833815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:08.924935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e2f94-bb6e-449b-815c-62035689b9b1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:08.962818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:08.963452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.963733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.964069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.974777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:08.976297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:08.992230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:08.993259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:08.994782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:08.994782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:08.994782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:08.994782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 428/861] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:09.002929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:09.109827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e815d-4f5c-4758-a782-e9ef05d16615 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:09.145551 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:09.146192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:09.146474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:09.146747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:09.147509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:09.147817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:09.149258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:09.163574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 434/862] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:09.169458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:09.240939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:09.275409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac979b-5f2f-471f-9fa8-d425222069d4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:09.310426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:09.310979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:09.311258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:09.311531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:09.319087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:09.320529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:09.331845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:09.332804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:09.334402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 429/863] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:17:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:09.339121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:09.361890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:09.444009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042572-4370-45be-988c-0a36ea2eb6c6 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:09.480037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:09.480817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:09.480995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:09.481145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:09.481902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:09.482205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:09.483635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:09.501643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 435/864] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Aug 23 16:17:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:09.507240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:09.619292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a62180-2de3-439d-a785-5a7d71b45dea None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:09.648915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:09.657644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95e811-0f92-4649-8f45-83c7777080a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:09.665022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95e811-0f92-4649-8f45-83c7777080a9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:09.665022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95e811-0f92-4649-8f45-83c7777080a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:09.665022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95e811-0f92-4649-8f45-83c7777080a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:09.728232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95e811-0f92-4649-8f45-83c7777080a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:09.730058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95e811-0f92-4649-8f45-83c7777080a9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:09.830539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 430/865] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:17:09.838155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:09.926231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:09.931598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a7f7-5bdb-4d42-940a-108f00931b83 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:09.931878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a7f7-5bdb-4d42-940a-108f00931b83 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:09.932221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4a7f7-5bdb-4d42-940a-108f00931b83 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:09.933922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 431/866] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:09.939962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69fc8a-f688-4924-9660-ad3c9e037c57 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:09.940448 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69fc8a-f688-4924-9660-ad3c9e037c57 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:09.941346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69fc8a-f688-4924-9660-ad3c9e037c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:09.951417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb89db-67f1-4748-8899-b86115bab8bc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:09.964606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fd69fc8a-f688-4924-9660-ad3c9e037c57 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:09.966328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fd69fc8a-f688-4924-9660-ad3c9e037c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:09.989908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:09.990852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:09.991331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:09.991813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:09.995114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:10.003656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:10.005184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:10.021077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:10.022120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:10.023092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:10.023092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:10.023092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:10.023092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 436/867] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:10.031047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:10.069731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 432/868] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:10.135938 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781b59d-6857-4bdb-aaba-234873359b74 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:10.164651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:10.170701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:10.171304 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.171583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.171858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.172504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:10.172806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:10.174256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:10.187442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 437/869] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:10.192881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69fc8a-f688-4924-9660-ad3c9e037c57 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:10.303047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69fc8a-f688-4924-9660-ad3c9e037c57 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:10.338853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:10.339493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.339772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.340045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.346972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:10.348416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:10.359689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:10.361187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:10.362149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:10.363097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 433/870] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:10.370836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:10.391033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:10.475188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c12f6-8cb2-4eec-add4-5fe2ba8a2b3f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:10.476880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453113-6c4f-4b2c-8269-daca1d5c1400 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:10.511552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22b53-8584-4579-b830-a187d56c4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:10.512156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22b53-8584-4579-b830-a187d56c4526 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.512434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22b53-8584-4579-b830-a187d56c4526 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.512709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22b53-8584-4579-b830-a187d56c4526 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.513396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22b53-8584-4579-b830-a187d56c4526 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:10.513731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22b53-8584-4579-b830-a187d56c4526 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:10.514369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62e24b-9f0c-4076-bddb-fe4b587caa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:10.515159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22b53-8584-4579-b830-a187d56c4526 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:10.515739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e24b-9f0c-4076-bddb-fe4b587caa02 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.516214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e24b-9f0c-4076-bddb-fe4b587caa02 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.516792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62e24b-9f0c-4076-bddb-fe4b587caa02 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.517781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62e24b-9f0c-4076-bddb-fe4b587caa02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:10.519356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62e24b-9f0c-4076-bddb-fe4b587caa02 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:10.527405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 434/871] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:10.528446 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a266c1-1199-4647-bd16-ff93306c0c63 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.528731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a266c1-1199-4647-bd16-ff93306c0c63 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.529002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a266c1-1199-4647-bd16-ff93306c0c63 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.533662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 435/872] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:10.533662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a266c1-1199-4647-bd16-ff93306c0c63 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:10.607729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 438/873] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:17:10 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:10.609921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da766-4991-4c45-8aa8-0021acea80ab None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.610911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da766-4991-4c45-8aa8-0021acea80ab None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.611401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da766-4991-4c45-8aa8-0021acea80ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.612538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:10.639120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-158da766-4991-4c45-8aa8-0021acea80ab None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:10.641497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-158da766-4991-4c45-8aa8-0021acea80ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:10.646680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a266c1-1199-4647-bd16-ff93306c0c63 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:10.700040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c371f-0966-47ad-aad0-6a61e486b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:10.702062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c371f-0966-47ad-aad0-6a61e486b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.702641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c371f-0966-47ad-aad0-6a61e486b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.703105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c371f-0966-47ad-aad0-6a61e486b1a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.704099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:10.704295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c371f-0966-47ad-aad0-6a61e486b1a8 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=cc5ff4a4b258472d90e7e9efd94d8808) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:10.704802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c371f-0966-47ad-aad0-6a61e486b1a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:10.707093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c371f-0966-47ad-aad0-6a61e486b1a8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:10.721908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 436/874] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:10 2022] GET /identity/v3/role_assignments?user.id=cc5ff4a4b258472d90e7e9efd94d8808&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:10.739522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 439/875] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:10.786109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1c117-61f7-4339-8137-d67fc189b109 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.786435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1c117-61f7-4339-8137-d67fc189b109 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.786660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1c117-61f7-4339-8137-d67fc189b109 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.788456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 437/876] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:10.794777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c49305-d15e-481e-ae2b-77207dff92cb None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:10.795067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c49305-d15e-481e-ae2b-77207dff92cb None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:10.795348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c49305-d15e-481e-ae2b-77207dff92cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:10.816278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f5c49305-d15e-481e-ae2b-77207dff92cb None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:10.817508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f5c49305-d15e-481e-ae2b-77207dff92cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:10.894828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 440/877] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:11.014139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1c117-61f7-4339-8137-d67fc189b109 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:11.136175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1c117-61f7-4339-8137-d67fc189b109 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:11.165438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c49305-d15e-481e-ae2b-77207dff92cb None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:11.177868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05207d-d145-4b1e-a9a0-14592b3059fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:11.178910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05207d-d145-4b1e-a9a0-14592b3059fb None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:11.179200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05207d-d145-4b1e-a9a0-14592b3059fb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:11.179778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05207d-d145-4b1e-a9a0-14592b3059fb None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:11.180456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05207d-d145-4b1e-a9a0-14592b3059fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:11.182640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05207d-d145-4b1e-a9a0-14592b3059fb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:11.271658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c49305-d15e-481e-ae2b-77207dff92cb None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:11.283059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:11.307598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:11.308233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:11.308511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:11.308782 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:11.309374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:11.310857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:11.319550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:11.320811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:11.321954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 441/878] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:11.333571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:11.333684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:11.333770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 438/879] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:17:11 2022] POST /identity/v3/services => generated 269 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:11.449037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed310c16-4f1e-4425-bcdc-31b304af8238 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:11.494689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df9dff-6976-4f91-b102-5796b243bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:11.495332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df9dff-6976-4f91-b102-5796b243bc06 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:11.495613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df9dff-6976-4f91-b102-5796b243bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:11.495887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df9dff-6976-4f91-b102-5796b243bc06 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:11.496520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df9dff-6976-4f91-b102-5796b243bc06 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:11.496822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df9dff-6976-4f91-b102-5796b243bc06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:11.498230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df9dff-6976-4f91-b102-5796b243bc06 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:11.503317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 442/880] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:11.509014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05207d-d145-4b1e-a9a0-14592b3059fb None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:11.615850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05207d-d145-4b1e-a9a0-14592b3059fb None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:11.651077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcbc1e-ae69-4cd2-b28d-136a99e4c372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:11.651693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcbc1e-ae69-4cd2-b28d-136a99e4c372 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:11.651977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcbc1e-ae69-4cd2-b28d-136a99e4c372 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:11.652253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcbc1e-ae69-4cd2-b28d-136a99e4c372 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:11.652894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcbc1e-ae69-4cd2-b28d-136a99e4c372 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:11.653199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcbc1e-ae69-4cd2-b28d-136a99e4c372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:11.654602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcbc1e-ae69-4cd2-b28d-136a99e4c372 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:11.659766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 439/881] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:12.642308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3739-5b80-4852-b163-f8a7222a31e6 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:12.642843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3739-5b80-4852-b163-f8a7222a31e6 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:12.642843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3739-5b80-4852-b163-f8a7222a31e6 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:12.644461 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 443/882] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:12.649604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb6d6-2116-49c3-9dab-6fc921f5c2e8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:12.650592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb6d6-2116-49c3-9dab-6fc921f5c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:12.651074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdb6d6-2116-49c3-9dab-6fc921f5c2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:12.669559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f0bdb6d6-2116-49c3-9dab-6fc921f5c2e8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:12.671097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f0bdb6d6-2116-49c3-9dab-6fc921f5c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:12.724292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa1f3-024e-4167-ac07-4a6b1c4cda7c None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:12.724570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa1f3-024e-4167-ac07-4a6b1c4cda7c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:12.725095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fa1f3-024e-4167-ac07-4a6b1c4cda7c None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:12.727038 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 444/883] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:12.732363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:12.733695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800c95f-051a-468f-bd31-c5f8b1d2487b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:12.733879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800c95f-051a-468f-bd31-c5f8b1d2487b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:12.734155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800c95f-051a-468f-bd31-c5f8b1d2487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:12.750341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 440/884] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:12.759595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4800c95f-051a-468f-bd31-c5f8b1d2487b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:12.760977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4800c95f-051a-468f-bd31-c5f8b1d2487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:12.790039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:12.832299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 445/885] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:13.021640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb6d6-2116-49c3-9dab-6fc921f5c2e8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.095237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800c95f-051a-468f-bd31-c5f8b1d2487b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.127423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdb6d6-2116-49c3-9dab-6fc921f5c2e8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.163923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.164556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.164838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.165110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.165753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:13.167119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:13.176690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:13.177740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:13.178596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 441/886] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:13.184799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.207410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800c95f-051a-468f-bd31-c5f8b1d2487b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.243751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:13.245205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db507df6-3d27-46d5-81b0-dbcc3adfb891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.246124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507df6-3d27-46d5-81b0-dbcc3adfb891 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.246631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507df6-3d27-46d5-81b0-dbcc3adfb891 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.247134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507df6-3d27-46d5-81b0-dbcc3adfb891 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.258267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db507df6-3d27-46d5-81b0-dbcc3adfb891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-db507df6-3d27-46d5-81b0-dbcc3adfb891 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:13.263387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:13.270758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:13.271749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:13.272891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 446/887] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:13.274222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db507df6-3d27-46d5-81b0-dbcc3adfb891 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.290245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e07ae6-58cf-4898-8eb6-f5bc48c8b76b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.305496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:13.325808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.326413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.326696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.326964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.327596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:13.327894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:13.329436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:13.339225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 442/888] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:13.340421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.388984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db507df6-3d27-46d5-81b0-dbcc3adfb891 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.426129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cfb1f-98c6-4b82-a2d7-93140df024a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.426659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cfb1f-98c6-4b82-a2d7-93140df024a4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.426942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cfb1f-98c6-4b82-a2d7-93140df024a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.427218 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cfb1f-98c6-4b82-a2d7-93140df024a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.427889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cfb1f-98c6-4b82-a2d7-93140df024a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:13.428191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cfb1f-98c6-4b82-a2d7-93140df024a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:13.429569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cfb1f-98c6-4b82-a2d7-93140df024a4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:13.441665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 447/889] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:13.441665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef9ca0-8a5d-437b-a8b2-36109fa6edb9 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.441665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef9ca0-8a5d-437b-a8b2-36109fa6edb9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.441665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef9ca0-8a5d-437b-a8b2-36109fa6edb9 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.441665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 448/890] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:13.446159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef9ca0-8a5d-437b-a8b2-36109fa6edb9 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.449207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31859f2d-547a-4c0d-b997-bc5f4ce0c58e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.470374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:13.486815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e704b22-da1f-45b3-bbf2-29dda2e07972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.487420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704b22-da1f-45b3-bbf2-29dda2e07972 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.487701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704b22-da1f-45b3-bbf2-29dda2e07972 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.487974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e704b22-da1f-45b3-bbf2-29dda2e07972 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.488930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e704b22-da1f-45b3-bbf2-29dda2e07972 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:13.489247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e704b22-da1f-45b3-bbf2-29dda2e07972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:13.490643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e704b22-da1f-45b3-bbf2-29dda2e07972 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:13.500596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 443/891] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:13.500596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b79ca-580b-42c3-8f88-818da949be7e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.500596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b79ca-580b-42c3-8f88-818da949be7e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.500596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b79ca-580b-42c3-8f88-818da949be7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.515097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bb8b79ca-580b-42c3-8f88-818da949be7e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:13.516275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bb8b79ca-580b-42c3-8f88-818da949be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:13.548119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:13.564092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef9ca0-8a5d-437b-a8b2-36109fa6edb9 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.585766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 444/892] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:13.586624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b79ca-580b-42c3-8f88-818da949be7e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.605138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec9ff3-484c-45b2-bd59-7ab5ed45d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.605806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec9ff3-484c-45b2-bd59-7ab5ed45d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.606090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec9ff3-484c-45b2-bd59-7ab5ed45d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.606362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec9ff3-484c-45b2-bd59-7ab5ed45d9e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.616934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec9ff3-484c-45b2-bd59-7ab5ed45d9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:13.618441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec9ff3-484c-45b2-bd59-7ab5ed45d9e1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-74ec9ff3-484c-45b2-bd59-7ab5ed45d9e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:13.632749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:13.633785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:13.635279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:13.635279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:13.635279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:13.635279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 449/893] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:13.635789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c48b-6866-4616-8810-4c9d120cac3b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.635934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c48b-6866-4616-8810-4c9d120cac3b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.636215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c48b-6866-4616-8810-4c9d120cac3b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.641415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 450/894] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:13.641415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52c48b-6866-4616-8810-4c9d120cac3b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.703040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b79ca-580b-42c3-8f88-818da949be7e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.718016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:13.739096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51a383-7001-4cf7-ac78-a29184fea921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.739693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a383-7001-4cf7-ac78-a29184fea921 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.739971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a383-7001-4cf7-ac78-a29184fea921 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.740245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a383-7001-4cf7-ac78-a29184fea921 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.740936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51a383-7001-4cf7-ac78-a29184fea921 None admin] RBAC: Adding query filter params (interface=public, service_id=093ebd9b3d0e48a8ad51231c32b9544c, region_id=RegionOne) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:13.741239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51a383-7001-4cf7-ac78-a29184fea921 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:13.742680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51a383-7001-4cf7-ac78-a29184fea921 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:13.751357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 445/895] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/endpoints?service_id=093ebd9b3d0e48a8ad51231c32b9544c&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:13.752320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5964533-07ef-4ba4-89e7-9a08db0178d8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.752603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5964533-07ef-4ba4-89e7-9a08db0178d8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.752875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5964533-07ef-4ba4-89e7-9a08db0178d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.758150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52c48b-6866-4616-8810-4c9d120cac3b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.770669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e5964533-07ef-4ba4-89e7-9a08db0178d8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:13.771836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e5964533-07ef-4ba4-89e7-9a08db0178d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:13.794147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.794750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.795030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.795300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.795939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:13.796241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:13.797604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:13.804084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:13.814858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 451/896] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:13.814858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.846207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 446/897] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:13.847249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5964533-07ef-4ba4-89e7-9a08db0178d8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:13.924043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927cf4-c6be-4bb5-98d7-0769270468e3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.963841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5964533-07ef-4ba4-89e7-9a08db0178d8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:13.965966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3314d65-d00a-49b3-878e-5a6d007dadb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:13.966957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314d65-d00a-49b3-878e-5a6d007dadb5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:13.966957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314d65-d00a-49b3-878e-5a6d007dadb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:13.967134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3314d65-d00a-49b3-878e-5a6d007dadb5 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:13.967691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3314d65-d00a-49b3-878e-5a6d007dadb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:13.969043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3314d65-d00a-49b3-878e-5a6d007dadb5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:13.973933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:13.985977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 452/898] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:17:13.986820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3314d65-d00a-49b3-878e-5a6d007dadb5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.006778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.008600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.009739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.010868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.022599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.025702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:14.042650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:14.043683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:14.044634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:14.048783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 447/899] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:14.050191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.076378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:14.126081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3314d65-d00a-49b3-878e-5a6d007dadb5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.161964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.162601 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.162888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.163163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.163750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.165122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:14.174511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:14.175590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:14.176505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:14.177277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f4b23-c10c-49c0-aae6-829a2323be5c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.177355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 453/900] 10.222.0.61 () {56 vars in 1132 bytes} [Tue Aug 23 16:17:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:14.177355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.217044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.218077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.218561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.219032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.220013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:14.220382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.222068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.240376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 448/901] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Aug 23 16:17:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:14.241243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.268683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:14.292658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649bd26-9ab1-4723-a6a0-7455eed32059 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.319210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:14.329102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d44f4a-95bd-4537-8864-1cc5f9faa5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.333175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44f4a-95bd-4537-8864-1cc5f9faa5b7 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.333175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44f4a-95bd-4537-8864-1cc5f9faa5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.333175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d44f4a-95bd-4537-8864-1cc5f9faa5b7 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.333175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d44f4a-95bd-4537-8864-1cc5f9faa5b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.333175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d44f4a-95bd-4537-8864-1cc5f9faa5b7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.347160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3ba30-58b7-4320-96d1-6aae278e3509 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.381383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.382035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.382314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.382584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.383208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:14.383508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.384885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.389444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 449/902] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:14.390267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.396833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 454/903] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:17:14 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:14.397778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d44f4a-95bd-4537-8864-1cc5f9faa5b7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.502068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:14.510604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a0ebb-7fa0-4c03-8caa-deff34411f0e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.529403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d44f4a-95bd-4537-8864-1cc5f9faa5b7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.550949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af674-068b-419c-830a-411b802a56ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.551809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af674-068b-419c-830a-411b802a56ee None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.552238 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af674-068b-419c-830a-411b802a56ee None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.552699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38af674-068b-419c-830a-411b802a56ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.568247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.568875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.569158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.569484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.570094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:14.570398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.572430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.577884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 455/904] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:14.583951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.640741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38af674-068b-419c-830a-411b802a56ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.642545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38af674-068b-419c-830a-411b802a56ee None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.653828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:14.726820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c805-d6bb-4aaa-ba51-12dc37714146 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.741327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:14.758642 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 450/905] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:17:14.760413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af674-068b-419c-830a-411b802a56ee None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.770230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.770849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.771133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.771468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.772603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] RBAC: Adding query filter params (interface=public, service_id=3ba6c332a8c64fb3ab63a5f88a909db6, region_id=RegionOne) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:14.772918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.774935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.785700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 456/906] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Aug 23 16:17:14 2022] GET /identity/v3/endpoints?service_id=3ba6c332a8c64fb3ab63a5f88a909db6&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:14.787861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:14.890680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38af674-068b-419c-830a-411b802a56ee None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.905322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cac1c-1e73-4262-b875-374f215a43ff None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:14.925983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:14.929810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.930503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.930787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.931088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.941933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.943379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.951758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf35c6b-6495-4b38-ad79-aefcd59a717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:14.952672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf35c6b-6495-4b38-ad79-aefcd59a717c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:14.953671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf35c6b-6495-4b38-ad79-aefcd59a717c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:14.954304 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf35c6b-6495-4b38-ad79-aefcd59a717c None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:14.955321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf35c6b-6495-4b38-ad79-aefcd59a717c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:14.957041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf35c6b-6495-4b38-ad79-aefcd59a717c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:14.961040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:14.962011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:14.963489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:14.963489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:14.963489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:14.973984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 451/908] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:14.974198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 457/908] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:17:14 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:17:14.974957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:15.028062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:15.101201 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12efa42-baa3-46aa-8988-474880abf3a3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:15.141488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:15.142047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:15.142329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:15.142600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:15.143249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:15.143552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:15.144914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:15.157283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 452/909] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:15.163589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf35c6b-6495-4b38-ad79-aefcd59a717c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:15.276399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf35c6b-6495-4b38-ad79-aefcd59a717c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:15.312065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:15.312997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:15.313500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:15.313993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:15.321097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:15.323433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:15.335287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:15.336221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:15.337123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:15.337123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:15.337123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:15.337123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:15.337123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:15.337123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:15.337123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:15.337123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:15.339128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 458/910] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:15.346763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:15.455245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a55631-927a-4af6-9a4a-5cb95d69ebe0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:15.456882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:15.490363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2209bd-7aa8-45de-b705-e04799b378f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:15.490969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2209bd-7aa8-45de-b705-e04799b378f7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:15.491251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2209bd-7aa8-45de-b705-e04799b378f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:15.491519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2209bd-7aa8-45de-b705-e04799b378f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:15.492213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2209bd-7aa8-45de-b705-e04799b378f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:15.492514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2209bd-7aa8-45de-b705-e04799b378f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:15.494508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2209bd-7aa8-45de-b705-e04799b378f7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:15.507824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 453/911] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:15.514160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:15.551781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:15.622941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0159f09-8b34-4b02-b255-ff51fbfb2c92 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:15.658524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52801fdb-bb93-4320-9293-851599248429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:15.659497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801fdb-bb93-4320-9293-851599248429 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:15.660031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801fdb-bb93-4320-9293-851599248429 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:15.660510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801fdb-bb93-4320-9293-851599248429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:15.661454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52801fdb-bb93-4320-9293-851599248429 None admin] RBAC: Adding query filter params (role.id=85aa7bc7e20e41dca9a6c387365d42be, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=cc5ff4a4b258472d90e7e9efd94d8808) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:15.661995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52801fdb-bb93-4320-9293-851599248429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:15.663647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52801fdb-bb93-4320-9293-851599248429 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:15.669787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 459/912] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:15 2022] GET /identity/v3/role_assignments?user.id=cc5ff4a4b258472d90e7e9efd94d8808&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=85aa7bc7e20e41dca9a6c387365d42be => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:15.960030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5311-9d40-452c-9547-74e08bf3f48a None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:15.960558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5311-9d40-452c-9547-74e08bf3f48a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:15.960558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5311-9d40-452c-9547-74e08bf3f48a None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:15.962232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 454/913] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:15.967829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56887c31-5a13-4ceb-bfa7-8c829499d987 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:15.968249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56887c31-5a13-4ceb-bfa7-8c829499d987 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:15.968419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56887c31-5a13-4ceb-bfa7-8c829499d987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:15.986575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-56887c31-5a13-4ceb-bfa7-8c829499d987 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:15.987778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-56887c31-5a13-4ceb-bfa7-8c829499d987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:16.060147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 460/914] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:16.331897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5311-9d40-452c-9547-74e08bf3f48a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:16.397417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224586c-1c10-443b-8155-d7677aa7f690 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.397766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224586c-1c10-443b-8155-d7677aa7f690 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.398005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224586c-1c10-443b-8155-d7677aa7f690 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.399610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 461/915] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:16.405294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3564e7-d4aa-4a46-9ea7-415eb7087c1e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.405577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3564e7-d4aa-4a46-9ea7-415eb7087c1e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.405947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3564e7-d4aa-4a46-9ea7-415eb7087c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.426878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-3b3564e7-d4aa-4a46-9ea7-415eb7087c1e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:16.428401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3b3564e7-d4aa-4a46-9ea7-415eb7087c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:16.441068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5311-9d40-452c-9547-74e08bf3f48a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:16.462013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:16.484384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:16.485146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.489208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.489208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.489208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:16.489208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:16.499611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:16.500707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:16.501594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 455/916] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:16.508444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:16.512837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 462/917] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:16.542070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:16.612930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadb520-0e29-4b6d-9d9d-3e094a69a04d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:16.648841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:16.649447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.650295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.650575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.651206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:16.651503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:16.652869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:16.658303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 456/918] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:16.666972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3564e7-d4aa-4a46-9ea7-415eb7087c1e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:16.778814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:16.779637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3564e7-d4aa-4a46-9ea7-415eb7087c1e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:16.815424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:16.816153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.816434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.816821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.817456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:16.817798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:16.819177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:16.824654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 463/919] 10.222.0.61 () {56 vars in 1114 bytes} [Tue Aug 23 16:17:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:16.830775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:16.863072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:16.888550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:16.900548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683bbf2-fad7-40a0-bc1a-1a15a81b49af None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:16.946291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:16.948606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.949639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.950833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.952685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:16.954988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:16.960502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70410e55-463e-4e19-b0c7-6fdf4792e534 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:16.966422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:16.967956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:16.969000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:16.972102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 457/920] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:16.977460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:17.009189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbef07-6ed8-4d65-98db-144407125206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:17.011097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbef07-6ed8-4d65-98db-144407125206 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.011577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbef07-6ed8-4d65-98db-144407125206 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.012091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbef07-6ed8-4d65-98db-144407125206 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.013182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbef07-6ed8-4d65-98db-144407125206 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:17.014813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbef07-6ed8-4d65-98db-144407125206 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:17.075891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 464/921] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:17:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:17.075891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b408-6dfd-4834-b928-c3150b9fc713 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.075891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b408-6dfd-4834-b928-c3150b9fc713 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.075891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b408-6dfd-4834-b928-c3150b9fc713 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.075891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 465/922] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:17.083223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c008cc-c86b-4260-97ed-42f431ddbc65 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.083518 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c008cc-c86b-4260-97ed-42f431ddbc65 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.084621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c008cc-c86b-4260-97ed-42f431ddbc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.101571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760159af-411b-4060-84f0-d865a043bc28 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:17.109694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f6c008cc-c86b-4260-97ed-42f431ddbc65 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:17.111722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f6c008cc-c86b-4260-97ed-42f431ddbc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:17.162077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:17.162689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.162970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.163244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.163881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:17.164489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:17.167683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:17.177917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 458/923] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:17.180193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:17.204938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:17.213808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 466/924] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:17.296399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6357-d6e0-41cc-92e0-44feef996288 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:17.333322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:17.334322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.334859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.335353 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.336202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:17.336709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:17.338324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:17.343777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 459/925] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:17.349852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c008cc-c86b-4260-97ed-42f431ddbc65 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:17.361516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:17.455275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c008cc-c86b-4260-97ed-42f431ddbc65 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:17.479357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:17.496197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defecad-d193-40b8-91c3-297105485316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:17.497078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defecad-d193-40b8-91c3-297105485316 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.497362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defecad-d193-40b8-91c3-297105485316 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.497656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defecad-d193-40b8-91c3-297105485316 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.498369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defecad-d193-40b8-91c3-297105485316 None admin] RBAC: Adding query filter params (interface=public, service_id=fc8d5e44d65f4b948f4690404ae96021, region_id=RegionOne) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:17.498681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defecad-d193-40b8-91c3-297105485316 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:17.500562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defecad-d193-40b8-91c3-297105485316 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:17.510881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 467/926] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Aug 23 16:17:17 2022] GET /identity/v3/endpoints?service_id=fc8d5e44d65f4b948f4690404ae96021&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:17.512816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defecad-d193-40b8-91c3-297105485316 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:17.570219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:17.597011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f070c81-d924-4d7b-9ec6-7e2f1c778667 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:17.603177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:17.637828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defecad-d193-40b8-91c3-297105485316 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:17.642156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95767ef-ca8b-4865-a8f9-7ceac4117ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:17.642798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95767ef-ca8b-4865-a8f9-7ceac4117ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.643082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95767ef-ca8b-4865-a8f9-7ceac4117ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.643360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95767ef-ca8b-4865-a8f9-7ceac4117ae4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.643999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95767ef-ca8b-4865-a8f9-7ceac4117ae4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:17.646243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95767ef-ca8b-4865-a8f9-7ceac4117ae4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a95767ef-ca8b-4865-a8f9-7ceac4117ae4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:17.656231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:17.657185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:17.663266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 460/927] 10.222.0.61 () {56 vars in 1132 bytes} [Tue Aug 23 16:17:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:17.664354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6f3d-c047-40af-9b71-f1a49aada5d0 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.664354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6f3d-c047-40af-9b71-f1a49aada5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.664354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f6f3d-c047-40af-9b71-f1a49aada5d0 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.664354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 461/928] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:17.665471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f6f3d-c047-40af-9b71-f1a49aada5d0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:17.680361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6af9-503d-4dfb-9d0e-716e303c1773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:17.681510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6af9-503d-4dfb-9d0e-716e303c1773 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.681825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6af9-503d-4dfb-9d0e-716e303c1773 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.682106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6af9-503d-4dfb-9d0e-716e303c1773 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.682713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd6af9-503d-4dfb-9d0e-716e303c1773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:17.684070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd6af9-503d-4dfb-9d0e-716e303c1773 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:17.693656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 468/929] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:17:17 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:17:17.693656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6506b8-6b26-48c2-8bd9-cdd5f4ab15ea None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.693656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6506b8-6b26-48c2-8bd9-cdd5f4ab15ea None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.693656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6506b8-6b26-48c2-8bd9-cdd5f4ab15ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.710459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8b6506b8-6b26-48c2-8bd9-cdd5f4ab15ea None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:17.712922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8b6506b8-6b26-48c2-8bd9-cdd5f4ab15ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:17.795552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f6f3d-c047-40af-9b71-f1a49aada5d0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:17.803826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 469/930] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:17.833830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:17.834460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.834739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.835013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.835655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:17.836030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:17.838101 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:17.843689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 462/931] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:17.849524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6506b8-6b26-48c2-8bd9-cdd5f4ab15ea None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:17.921132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:17.957433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6506b8-6b26-48c2-8bd9-cdd5f4ab15ea None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:17.997921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:17.998454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:17.998739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:17.999016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:17.999657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:17.999960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:18.001330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:18.006678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 470/932] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:18.012600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:18.022180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:18.117540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed2608-a41b-4e35-9d22-681e45421aa7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:18.123281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:18.154555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843de6-1acf-4822-bf6c-798b625be32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:18.155266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843de6-1acf-4822-bf6c-798b625be32f None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:18.155555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843de6-1acf-4822-bf6c-798b625be32f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:18.155831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843de6-1acf-4822-bf6c-798b625be32f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:18.156513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18843de6-1acf-4822-bf6c-798b625be32f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:18.158052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18843de6-1acf-4822-bf6c-798b625be32f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:18.234373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb586f-5ba2-4111-b929-c28851df4c4e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:18.262497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 463/933] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:17:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:18.272969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:18.286775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedb161-68e1-4d0b-b866-56540e04e1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:18.288633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb161-68e1-4d0b-b866-56540e04e1fc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:18.288633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb161-68e1-4d0b-b866-56540e04e1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:18.288633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedb161-68e1-4d0b-b866-56540e04e1fc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:18.301484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedb161-68e1-4d0b-b866-56540e04e1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-6eedb161-68e1-4d0b-b866-56540e04e1fc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:18.307168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:18.308177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:18.309034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:18.313047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 471/934] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Aug 23 16:17:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:18.315352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843de6-1acf-4822-bf6c-798b625be32f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:18.389547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:18.432808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843de6-1acf-4822-bf6c-798b625be32f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:18.471462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:18.472073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:18.472352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:18.472623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:18.473410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:18.473752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:18.475185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:18.484773 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 464/935] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Aug 23 16:17:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:18.490532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedb161-68e1-4d0b-b866-56540e04e1fc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:18.594961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedb161-68e1-4d0b-b866-56540e04e1fc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:18.631607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:18.632633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:18.633136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:18.633634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:18.645282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:18.647073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:18.661974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:18.663063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:18.663979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:18.663979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:18.663979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:18.666644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 472/936] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:18.677631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:18.778068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fe100-89ff-41df-8656-8aa37afc8192 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:18.803281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:18.815475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:18.816359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:18.816809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:18.820570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:18.820570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:18.820570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:18.820570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:18.832508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 465/937] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:18.840387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:18.882882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:18.951133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca827e-3990-45ba-9cda-d9eb4901330d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:18.991302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17173f-133a-4cdc-913d-c77abec8106f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:18.991929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17173f-133a-4cdc-913d-c77abec8106f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:18.992204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17173f-133a-4cdc-913d-c77abec8106f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:18.992516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17173f-133a-4cdc-913d-c77abec8106f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.000429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17173f-133a-4cdc-913d-c77abec8106f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.001889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17173f-133a-4cdc-913d-c77abec8106f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-1d17173f-133a-4cdc-913d-c77abec8106f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:19.013847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:19.014790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.015745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 473/938] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:17:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:19.021157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.069479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486529e2-149e-4f02-98ee-35befcc82d0a None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.069986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486529e2-149e-4f02-98ee-35befcc82d0a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.070444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486529e2-149e-4f02-98ee-35befcc82d0a None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.076295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 474/939] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:19.077868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db773-3f64-442c-b2e3-ccfc330b9ed1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.078308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db773-3f64-442c-b2e3-ccfc330b9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.078745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818db773-3f64-442c-b2e3-ccfc330b9ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.097010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-818db773-3f64-442c-b2e3-ccfc330b9ed1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:19.098427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-818db773-3f64-442c-b2e3-ccfc330b9ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:19.157198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e878ee-b6f6-4a9f-8f2f-97b9e9982098 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.176305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 475/940] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:19.197924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.198621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.198971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.199319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.200173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:19.200589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.202123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.220460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 466/941] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Aug 23 16:17:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:19.226148 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818db773-3f64-442c-b2e3-ccfc330b9ed1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.261015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:19.338940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818db773-3f64-442c-b2e3-ccfc330b9ed1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.374992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.375744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.376024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.376291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.387361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.388804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:19.404096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:19.405089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:19.406198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:19.406198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:19.406198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.406198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 476/942] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:19.412805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.459240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.461759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:19.524240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebce350-0bb1-423b-81a6-bc4f165b374d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.564073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:19.567837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.568465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.568917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.569187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.570401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:19.570707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.574091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.587090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346df5f-0697-41a8-b037-c525e49fb041 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.591734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 467/943] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:19.595981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.642666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.643430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.643806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.644175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.645086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.646963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.649641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING keystone.server.flask.common [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 16:17:19.698873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.sql.core [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:17:19.698873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 16:17:19.698873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [parameters: {'id': 'aebb94a4787148c4a7a8bfbc640f0fdb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 16:17:19.698873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81508) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aebb94a4787148c4a7a8bfbc640f0fdb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aebb94a4787148c4a7a8bfbc640f0fdb. Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:17:19.707656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application result.read() Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 16:17:19.708546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application yield resource Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise self.value Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application session.commit() Aug 23 16:17:19.709538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:17:19.710493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:17:19.711448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application result.read() Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:17:19.712816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [parameters: {'id': 'aebb94a4787148c4a7a8bfbc640f0fdb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:19.715096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:19.717041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id aebb94a4787148c4a7a8bfbc640f0fdb. Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 477/944] 10.222.0.61 () {60 vars in 1140 bytes} [Tue Aug 23 16:17:19 2022] POST /identity/v3/projects => generated 262 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:19.719202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.744163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840e249-55a7-44f6-becf-6301bb730831 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.745779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:19.785486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd440cd5-1ab2-4796-abfc-f5e9466e0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.786420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440cd5-1ab2-4796-abfc-f5e9466e0228 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.786706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440cd5-1ab2-4796-abfc-f5e9466e0228 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.786981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd440cd5-1ab2-4796-abfc-f5e9466e0228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.795588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd440cd5-1ab2-4796-abfc-f5e9466e0228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.797027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd440cd5-1ab2-4796-abfc-f5e9466e0228 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-bd440cd5-1ab2-4796-abfc-f5e9466e0228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:19.809418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:19.810511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 468/945] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf9b4-7822-4912-a40b-2bdd8c604e9e None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.816244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf9b4-7822-4912-a40b-2bdd8c604e9e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.816886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf9b4-7822-4912-a40b-2bdd8c604e9e None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.816886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 469/946] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:19.819133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf9b4-7822-4912-a40b-2bdd8c604e9e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.831147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f750-009f-4db3-8585-7c54037f6550 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.866723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07422b-44e7-4485-87b8-1731e5fc433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.867356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07422b-44e7-4485-87b8-1731e5fc433b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.867636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07422b-44e7-4485-87b8-1731e5fc433b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.867908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07422b-44e7-4485-87b8-1731e5fc433b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.871630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:19.876104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07422b-44e7-4485-87b8-1731e5fc433b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.880586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07422b-44e7-4485-87b8-1731e5fc433b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-9c07422b-44e7-4485-87b8-1731e5fc433b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:19.889441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:19.890394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:19.891303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 478/947] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:19.892298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06ccc1-eaa8-4d7b-b0c1-af6afe290a17 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.892298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06ccc1-eaa8-4d7b-b0c1-af6afe290a17 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.892298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06ccc1-eaa8-4d7b-b0c1-af6afe290a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.912119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-bb06ccc1-eaa8-4d7b-b0c1-af6afe290a17 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:19.913707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bb06ccc1-eaa8-4d7b-b0c1-af6afe290a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:19.947267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf9b4-7822-4912-a40b-2bdd8c604e9e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.990478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.991036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.991306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.991573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.992269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:19.992568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.994793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:20.009727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 479/948] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:20.009727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06ccc1-eaa8-4d7b-b0c1-af6afe290a17 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:20.018952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 470/949] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:20.025227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:20.069513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:20.131820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06ccc1-eaa8-4d7b-b0c1-af6afe290a17 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:20.150631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9f70-2b99-47a3-869c-515d40153036 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:20.160694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:20.171359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:20.175183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.175183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.175183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.175183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:20.175183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:20.176126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:20.186838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49b0be-ad66-474d-a1c5-15676ab8f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:20.187499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b0be-ad66-474d-a1c5-15676ab8f6dd None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.187779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b0be-ad66-474d-a1c5-15676ab8f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.188054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b0be-ad66-474d-a1c5-15676ab8f6dd None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/cc5ff4a4b258472d90e7e9efd94d8808/roles/85aa7bc7e20e41dca9a6c387365d42be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.190365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49b0be-ad66-474d-a1c5-15676ab8f6dd None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=cc5ff4a4b258472d90e7e9efd94d8808, role_id=85aa7bc7e20e41dca9a6c387365d42be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:20.191784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49b0be-ad66-474d-a1c5-15676ab8f6dd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:20.199747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 480/950] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:20.254557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 471/951] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:17:20 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/cc5ff4a4b258472d90e7e9efd94d8808/roles/85aa7bc7e20e41dca9a6c387365d42be => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:17:20.303181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:20.308478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c746-af90-44ed-86e2-287ae3fa933d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.308767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c746-af90-44ed-86e2-287ae3fa933d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.309052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c746-af90-44ed-86e2-287ae3fa933d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.310472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 472/952] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:20.317433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f316ae-dcd4-4fe5-aa5a-a5e68895c0c5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.317740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f316ae-dcd4-4fe5-aa5a-a5e68895c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.318075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f316ae-dcd4-4fe5-aa5a-a5e68895c0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.343544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c4f316ae-dcd4-4fe5-aa5a-a5e68895c0c5 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:20.344849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c4f316ae-dcd4-4fe5-aa5a-a5e68895c0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:20.436026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 473/953] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:20.447230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830bb33-12b6-4cef-8d49-cf658e5ed259 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:20.483800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:20.484431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.484706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.484977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.485637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:20.487092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:20.496592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:20.497796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:20.498739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 481/954] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:20.503838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f316ae-dcd4-4fe5-aa5a-a5e68895c0c5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:20.519193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:20.608535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f316ae-dcd4-4fe5-aa5a-a5e68895c0c5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:20.645034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:20.646106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.646612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.647101 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.647952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:20.648465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:20.650158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:20.655714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 474/955] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:20.664259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:20.705954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:20.717168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:20.785701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e561e-c0f6-4996-a172-627be916cc80 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:20.793990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:20.820612 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:20.821223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.821501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.821836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.822469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:20.822592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6562-9840-4cde-a069-d23743ce1067 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:20.822765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:20.824230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:20.829508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 482/956] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:20.834810 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:20.864447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:20.865244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.865881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.866216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.867087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:20.869522 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:20.880458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:20.884563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:20.885756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:20.887357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 475/957] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:20.895050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:20.955036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43db42-ff5d-45f8-b7de-026d44b0ef1f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:20.970620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:20.993094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2154f38-4d24-40d5-9bba-2994d833d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:20.994549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2154f38-4d24-40d5-9bba-2994d833d3fe None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:20.994927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2154f38-4d24-40d5-9bba-2994d833d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:20.995312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2154f38-4d24-40d5-9bba-2994d833d3fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:20.996083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2154f38-4d24-40d5-9bba-2994d833d3fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:20.997638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2154f38-4d24-40d5-9bba-2994d833d3fe None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:21.026186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9aea1-3f15-4a41-a4a2-8e199e46f83b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:21.066519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:21.067129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:21.067407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:21.067688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:21.068304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:21.068718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:21.070125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:21.081865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 476/959] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:21.082062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:21.082414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 483/959] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:17:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:17:21.086993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:21.196056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9384f-7985-4e9e-b3e3-f2c3cc03956b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:21.240395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ac54b-65b2-4f59-a434-b0b8adc34487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:21.241013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ac54b-65b2-4f59-a434-b0b8adc34487 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:21.241293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ac54b-65b2-4f59-a434-b0b8adc34487 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:21.241567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ac54b-65b2-4f59-a434-b0b8adc34487 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:21.242257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ac54b-65b2-4f59-a434-b0b8adc34487 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:21.242528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ac54b-65b2-4f59-a434-b0b8adc34487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:21.243975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ac54b-65b2-4f59-a434-b0b8adc34487 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:21.253779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 477/960] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:22.206822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62bec-4f9b-4aa4-984e-aafdd5b64211 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.207392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62bec-4f9b-4aa4-984e-aafdd5b64211 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.207392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62bec-4f9b-4aa4-984e-aafdd5b64211 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.209068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 484/961] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:22.215409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202aaf-2d4c-4b63-9bad-1b7f1f80fb6f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.215949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202aaf-2d4c-4b63-9bad-1b7f1f80fb6f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.215949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202aaf-2d4c-4b63-9bad-1b7f1f80fb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.234595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c1202aaf-2d4c-4b63-9bad-1b7f1f80fb6f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:22.235783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c1202aaf-2d4c-4b63-9bad-1b7f1f80fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:22.302174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:22.310726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 478/962] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:22.323087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630276-1db0-4c2e-8768-41e0eaf46323 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.323423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630276-1db0-4c2e-8768-41e0eaf46323 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.323647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630276-1db0-4c2e-8768-41e0eaf46323 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.325226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 485/963] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:22.330904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259c02-dec5-40a4-92a3-b0bc1a1cf865 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.331194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259c02-dec5-40a4-92a3-b0bc1a1cf865 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.331469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259c02-dec5-40a4-92a3-b0bc1a1cf865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.350550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b8259c02-dec5-40a4-92a3-b0bc1a1cf865 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:22.351768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b8259c02-dec5-40a4-92a3-b0bc1a1cf865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:22.421146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 479/964] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:22.576427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630276-1db0-4c2e-8768-41e0eaf46323 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:22.686210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630276-1db0-4c2e-8768-41e0eaf46323 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:22.695193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259c02-dec5-40a4-92a3-b0bc1a1cf865 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:22.721997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514516b4-4f00-4e0b-9bd5-68ec7a8ef8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:22.722623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514516b4-4f00-4e0b-9bd5-68ec7a8ef8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.722902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514516b4-4f00-4e0b-9bd5-68ec7a8ef8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.723172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514516b4-4f00-4e0b-9bd5-68ec7a8ef8e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.734526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514516b4-4f00-4e0b-9bd5-68ec7a8ef8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-514516b4-4f00-4e0b-9bd5-68ec7a8ef8e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:22.739760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:22.740947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:22.741985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 486/965] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Aug 23 16:17:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:22.749409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514516b4-4f00-4e0b-9bd5-68ec7a8ef8e0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:22.782864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:22.808920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259c02-dec5-40a4-92a3-b0bc1a1cf865 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:22.833444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:22.844893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:22.848625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.848625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.848625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.848625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:22.848946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:22.851986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING keystone.server.flask.common [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 16:17:22.862705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514516b4-4f00-4e0b-9bd5-68ec7a8ef8e0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:22.893954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.sql.core [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:17:22.893954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 16:17:22.893954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [parameters: {'user_id': 'a8bc4d46e9b14b7a9e4babe53d2ddb14', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 16:17:22.893954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81509) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:17:22.901777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:22.902691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.903155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.903618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.904527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:22.905034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:22.906618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application result.read() Aug 23 16:17:22.914092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:17:22.915052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application yield resource Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise self.value Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application session.commit() Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:17:22.916653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:17:22.917680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:17:22.918634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application result.read() Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:17:22.925344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a8bc4d46e9b14b7a9e4babe53d2ddb14', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:22.927371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 16:17:22.929106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 16:17:22.936123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 16:17:22.936123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 16:17:22.936123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:17:22.936123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:17:22.936123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 16:17:22.936123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:22.936123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 480/966] 10.222.0.61 () {60 vars in 1131 bytes} [Tue Aug 23 16:17:22 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:22.936724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 487/967] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Aug 23 16:17:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:22.936828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:22.936924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.041420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2f2fd-2462-4fdd-8d34-7cda141476e6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.050338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd46f91-36f4-49ba-a298-b130c834ee7a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.053831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:23.079490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951c8fc-96b0-4bae-be9c-5882392014b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.080371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c8fc-96b0-4bae-be9c-5882392014b9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.080828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c8fc-96b0-4bae-be9c-5882392014b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.081311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951c8fc-96b0-4bae-be9c-5882392014b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.092328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951c8fc-96b0-4bae-be9c-5882392014b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.092961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2151e-7920-4f84-a3ef-98d93edd7aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.094623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2151e-7920-4f84-a3ef-98d93edd7aee None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.094623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2151e-7920-4f84-a3ef-98d93edd7aee None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.095802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951c8fc-96b0-4bae-be9c-5882392014b9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.101754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2151e-7920-4f84-a3ef-98d93edd7aee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.110910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2151e-7920-4f84-a3ef-98d93edd7aee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.112472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2151e-7920-4f84-a3ef-98d93edd7aee None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-0951c8fc-96b0-4bae-be9c-5882392014b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:23.115042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:23.115991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:23.116916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:23.116916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:23.116916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:23.116916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 481/968] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:23.117820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3305-5870-405c-94e6-227f970d95b3 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.118104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3305-5870-405c-94e6-227f970d95b3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.118374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b3305-5870-405c-94e6-227f970d95b3 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.123116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 482/969] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:23.125724 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b3305-5870-405c-94e6-227f970d95b3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-dbb2151e-7920-4f84-a3ef-98d93edd7aee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:23.130513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:23.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:23.132971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 488/970] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:17:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:23.134477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15117c-dcb4-4f0b-aa33-07f4e8ae0ef4 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.134477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15117c-dcb4-4f0b-aa33-07f4e8ae0ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.134477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15117c-dcb4-4f0b-aa33-07f4e8ae0ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.151354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2a15117c-dcb4-4f0b-aa33-07f4e8ae0ef4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:23.152544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2a15117c-dcb4-4f0b-aa33-07f4e8ae0ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:23.175665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:23.226147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 489/971] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:23.227018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15117c-dcb4-4f0b-aa33-07f4e8ae0ef4 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.248315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b3305-5870-405c-94e6-227f970d95b3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.287766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be65afc-47bd-42e8-a8cb-3aeea313508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.288789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65afc-47bd-42e8-a8cb-3aeea313508f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.289334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65afc-47bd-42e8-a8cb-3aeea313508f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.289882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be65afc-47bd-42e8-a8cb-3aeea313508f None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.291281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be65afc-47bd-42e8-a8cb-3aeea313508f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:23.291799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be65afc-47bd-42e8-a8cb-3aeea313508f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.293636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be65afc-47bd-42e8-a8cb-3aeea313508f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.307178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 483/972] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:23.310938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e968278-5a26-4955-b7b8-de93486d8a80 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.311297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e968278-5a26-4955-b7b8-de93486d8a80 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.311718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e968278-5a26-4955-b7b8-de93486d8a80 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.313292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 484/973] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:23.314104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e968278-5a26-4955-b7b8-de93486d8a80 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.344653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:23.364567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15117c-dcb4-4f0b-aa33-07f4e8ae0ef4 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.403622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8f485-421b-43b9-b2d1-c580bc21499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.404535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f485-421b-43b9-b2d1-c580bc21499b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.404822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f485-421b-43b9-b2d1-c580bc21499b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.405097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f485-421b-43b9-b2d1-c580bc21499b None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.405848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8f485-421b-43b9-b2d1-c580bc21499b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:23.406150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8f485-421b-43b9-b2d1-c580bc21499b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.407590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8f485-421b-43b9-b2d1-c580bc21499b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.423482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:23.428671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e968278-5a26-4955-b7b8-de93486d8a80 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.458076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 490/974] 10.222.0.61 () {56 vars in 1101 bytes} [Tue Aug 23 16:17:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:23.459590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f234-fcfb-4ba8-adcd-71c4e106ac34 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.464295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.465060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.465429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.465802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.467230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f234-fcfb-4ba8-adcd-71c4e106ac34 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.467610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095f234-fcfb-4ba8-adcd-71c4e106ac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.475059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.476662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:23.491958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:23.493023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:17:23.494901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:23.498815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 485/975] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:17:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:23.500261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.516513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-0095f234-fcfb-4ba8-adcd-71c4e106ac34 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:23.517842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0095f234-fcfb-4ba8-adcd-71c4e106ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:23.624262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 491/976] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:23.624770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095f234-fcfb-4ba8-adcd-71c4e106ac34 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.635888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f36179-fbb8-4b5c-98f6-7c0d8f6c6559 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.689110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.692042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.692042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.692042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.692042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:23.692042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.693829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.719103 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 486/977] 10.222.0.61 () {56 vars in 1149 bytes} [Tue Aug 23 16:17:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:23.719380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:23.726108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.762735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:23.776223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095f234-fcfb-4ba8-adcd-71c4e106ac34 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.817702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.818777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.819338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.819672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.820257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.822248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:23.831594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:23.832652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:23.833532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 492/978] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:23.839072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.857290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fabbf-7273-43a5-9249-f123fb3a1a18 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.892525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882ce72-6ca4-4fcc-b67b-5eba60d75316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.893048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ce72-6ca4-4fcc-b67b-5eba60d75316 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.893325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ce72-6ca4-4fcc-b67b-5eba60d75316 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.893595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ce72-6ca4-4fcc-b67b-5eba60d75316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.942264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a586bb-5699-46f4-a396-0c9a0c0e1351 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:23.961123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882ce72-6ca4-4fcc-b67b-5eba60d75316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.963350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882ce72-6ca4-4fcc-b67b-5eba60d75316 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.976497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:23.977101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:23.977378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:23.977671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:23.978320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:23.978616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:23.979977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:23.981187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:23.986317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 493/979] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:23.987264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:23.996232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:24.087246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 487/980] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:17:24.089032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882ce72-6ca4-4fcc-b67b-5eba60d75316 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.101200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f21cf0-d7d3-4cfc-9c48-09aad03d67d1 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:24.134067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8703f6-e21a-4208-a646-d0d39fcf7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:24.135172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8703f6-e21a-4208-a646-d0d39fcf7922 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.135437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8703f6-e21a-4208-a646-d0d39fcf7922 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.135710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8703f6-e21a-4208-a646-d0d39fcf7922 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.136346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8703f6-e21a-4208-a646-d0d39fcf7922 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:24.137807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8703f6-e21a-4208-a646-d0d39fcf7922 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:24.186604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882ce72-6ca4-4fcc-b67b-5eba60d75316 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:24.189905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 494/981] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:17:23 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:24.190646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8703f6-e21a-4208-a646-d0d39fcf7922 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.205133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:24.233824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:24.234453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.234790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.235068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.235722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:24.236029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:24.237508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:24.243976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 488/982] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:24.250156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.272253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:24.337366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8703f6-e21a-4208-a646-d0d39fcf7922 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:24.373391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c0626-efbc-47ed-adf1-db37df777f4b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:24.377507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:24.378249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.378531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.378806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.392194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:24.393685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:24.409427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:24.410514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:24.411440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:24.411440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:24.411440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:24.411440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 495/983] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:24.416651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.416890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:24.417502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.417809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.418083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.418799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] RBAC: Adding query filter params (interface=admin, service_id=fc8d5e44d65f4b948f4690404ae96021, region_id=RegionOne) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:24.419107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:24.420465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:24.430160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 489/984] 10.222.0.61 () {56 vars in 1249 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/endpoints?service_id=fc8d5e44d65f4b948f4690404ae96021&interface=admin®ion_id=RegionOne => generated 193 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:24.431177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.473901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:24.527200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d4ef7-7f2d-448e-8dd5-4b6ae1595689 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:24.533674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083e669-760a-40fa-ba64-575be845c64d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:24.537648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:24.562641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:24.563845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.564201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.564548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.565267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:24.565672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:24.567045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:24.571319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa953c6-254b-479f-b014-35c92f256d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:24.572461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa953c6-254b-479f-b014-35c92f256d0a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.572737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa953c6-254b-479f-b014-35c92f256d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.573008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa953c6-254b-479f-b014-35c92f256d0a None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.573604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa953c6-254b-479f-b014-35c92f256d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:24.574970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa953c6-254b-479f-b014-35c92f256d0a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:24.580641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 496/985] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:24.589725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 490/986] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:17:24.589925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.702540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef3ae5-ca86-4913-83c0-07b0206e10cf None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:24.744399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:24.745248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.745747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.746205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.753718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:24.755173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:24.766852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:24.767964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:24.769080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 497/987] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:24.773880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa953c6-254b-479f-b014-35c92f256d0a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.875177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa953c6-254b-479f-b014-35c92f256d0a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:24.877755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:24.911146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ca549-3dbc-4e09-aa61-efc7db2f1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:24.911847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ca549-3dbc-4e09-aa61-efc7db2f1a3f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.912193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ca549-3dbc-4e09-aa61-efc7db2f1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.912533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ca549-3dbc-4e09-aa61-efc7db2f1a3f None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.913298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ca549-3dbc-4e09-aa61-efc7db2f1a3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:24.913700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ca549-3dbc-4e09-aa61-efc7db2f1a3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:24.915184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ca549-3dbc-4e09-aa61-efc7db2f1a3f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:24.932017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 491/988] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:24.933440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.964022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:25.043962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066f14-ba54-4e0e-86b6-fc4d6e896520 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:25.082017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a656c-739f-4b9a-8757-2c940984a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:25.082782 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a656c-739f-4b9a-8757-2c940984a5ba None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:25.083180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a656c-739f-4b9a-8757-2c940984a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:25.083551 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a656c-739f-4b9a-8757-2c940984a5ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:25.084380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a656c-739f-4b9a-8757-2c940984a5ba None admin] RBAC: Adding query filter params (role.id=85aa7bc7e20e41dca9a6c387365d42be, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=cc5ff4a4b258472d90e7e9efd94d8808) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:25.084794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a656c-739f-4b9a-8757-2c940984a5ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:25.086358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a656c-739f-4b9a-8757-2c940984a5ba None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:25.098600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 498/989] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/role_assignments?user.id=cc5ff4a4b258472d90e7e9efd94d8808&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=85aa7bc7e20e41dca9a6c387365d42be => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:26.104026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757d0c7-a4d7-42fd-b491-373217726724 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:26.104544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757d0c7-a4d7-42fd-b491-373217726724 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:26.104544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757d0c7-a4d7-42fd-b491-373217726724 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:26.106095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 492/990] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:26.111084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf748dd-7d3e-4c25-b2e1-59aacd0803fa None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:26.111504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf748dd-7d3e-4c25-b2e1-59aacd0803fa None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:26.111670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf748dd-7d3e-4c25-b2e1-59aacd0803fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:26.130546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ebf748dd-7d3e-4c25-b2e1-59aacd0803fa None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:26.131726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ebf748dd-7d3e-4c25-b2e1-59aacd0803fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:26.200478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 499/991] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:26.459033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757d0c7-a4d7-42fd-b491-373217726724 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:26.498861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa583f-241d-410f-a1d8-339bb0d393b8 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:26.499211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa583f-241d-410f-a1d8-339bb0d393b8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:26.499423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa583f-241d-410f-a1d8-339bb0d393b8 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:26.501090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 500/992] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:26.505706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579d0f-08ad-4b98-b0ca-55ffb107887d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:26.505989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579d0f-08ad-4b98-b0ca-55ffb107887d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:26.506264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579d0f-08ad-4b98-b0ca-55ffb107887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:26.523865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-63579d0f-08ad-4b98-b0ca-55ffb107887d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:26.525653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-63579d0f-08ad-4b98-b0ca-55ffb107887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:26.543613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:26.567670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757d0c7-a4d7-42fd-b491-373217726724 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:26.599852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 501/993] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:26.605128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:26.605788 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:26.606067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:26.606336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:26.606916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:26.608264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:26.617163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:26.618358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:26.619223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:26.620662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 493/994] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:26.624024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63579d0f-08ad-4b98-b0ca-55ffb107887d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:26.724286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63579d0f-08ad-4b98-b0ca-55ffb107887d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:26.758295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:26.758901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:26.759726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:26.760019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:26.760621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:26.761003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:26.762298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:26.771686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 502/995] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:26.772936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:26.802913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:26.874901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:26.877252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cb7e1-ebf0-4938-9fdc-c0ef9e65df09 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:26.894156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:26.914326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:26.915017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:26.915299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:26.916105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:26.916736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:26.917032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:26.918436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:26.923565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 494/996] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:26.929047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:26.981454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b680fa6-d5ac-4d64-8d93-51d28687dea2 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.016750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.017378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.017688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.017959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.018529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.019893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.024215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:27.029121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:27.030367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:27.031270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 503/997] 10.222.0.61 () {56 vars in 1126 bytes} [Tue Aug 23 16:17:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:27.037646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:27.038748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4620e5-2761-4b6f-b2fc-9524b7c69648 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.078252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8da6e-929c-4666-8ae2-cb1f4ec1c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.078864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8da6e-929c-4666-8ae2-cb1f4ec1c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.079141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8da6e-929c-4666-8ae2-cb1f4ec1c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.079409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8da6e-929c-4666-8ae2-cb1f4ec1c3b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.080163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8da6e-929c-4666-8ae2-cb1f4ec1c3b2 None admin] RBAC: Adding query filter params (interface=public, service_id=6e0f93dd59374167a6d585ff79d68063, region_id=RegionOne) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:27.080471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8da6e-929c-4666-8ae2-cb1f4ec1c3b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.081853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8da6e-929c-4666-8ae2-cb1f4ec1c3b2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.088292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 495/998] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Aug 23 16:17:26 2022] GET /identity/v3/endpoints?service_id=6e0f93dd59374167a6d585ff79d68063&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:27.092278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed199cce-a60d-4ac4-a069-fd2800377c3b None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.092634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed199cce-a60d-4ac4-a069-fd2800377c3b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.092915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed199cce-a60d-4ac4-a069-fd2800377c3b None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.094207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 496/999] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:27.094908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed199cce-a60d-4ac4-a069-fd2800377c3b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:27.128241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:27.146372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a4ccf-aa21-4a13-ab9d-e1d9e5c34abd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.182883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcaf64-77fd-4a9f-9b85-8fedd0af7fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.183494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcaf64-77fd-4a9f-9b85-8fedd0af7fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.183777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcaf64-77fd-4a9f-9b85-8fedd0af7fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.184050 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcaf64-77fd-4a9f-9b85-8fedd0af7fe9 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.184679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcaf64-77fd-4a9f-9b85-8fedd0af7fe9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:27.184990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcaf64-77fd-4a9f-9b85-8fedd0af7fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.186386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcaf64-77fd-4a9f-9b85-8fedd0af7fe9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.191226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 504/1000] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:27.192415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b9c4-46c1-4474-8b07-0aef8a6afbfe None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.192699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b9c4-46c1-4474-8b07-0aef8a6afbfe None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.192984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b9c4-46c1-4474-8b07-0aef8a6afbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.198149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed199cce-a60d-4ac4-a069-fd2800377c3b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.210783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-15f7b9c4-46c1-4474-8b07-0aef8a6afbfe None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:27.211981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-15f7b9c4-46c1-4474-8b07-0aef8a6afbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:27.231122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0916e-a6eb-468f-bfc6-54af7ca45f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.231778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0916e-a6eb-468f-bfc6-54af7ca45f02 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.232005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0916e-a6eb-468f-bfc6-54af7ca45f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.232274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0916e-a6eb-468f-bfc6-54af7ca45f02 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.232870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0916e-a6eb-468f-bfc6-54af7ca45f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.234247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0916e-a6eb-468f-bfc6-54af7ca45f02 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.240651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 497/1001] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:17:27 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:17:27.241433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0916e-a6eb-468f-bfc6-54af7ca45f02 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:27.266056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:27.299598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 505/1002] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:27.352697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0916e-a6eb-468f-bfc6-54af7ca45f02 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.392951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.393837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.394296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.394713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.395483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:27.395947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.397303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.402569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 498/1003] 10.222.0.61 () {56 vars in 1122 bytes} [Tue Aug 23 16:17:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:27.408204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7b9c4-46c1-4474-8b07-0aef8a6afbfe None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:27.487772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:27.511511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7b9c4-46c1-4474-8b07-0aef8a6afbfe None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.545250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8a05-e4fb-4a67-9b2f-0ee7b3f84345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.545881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8a05-e4fb-4a67-9b2f-0ee7b3f84345 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.546166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8a05-e4fb-4a67-9b2f-0ee7b3f84345 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.546441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f8a05-e4fb-4a67-9b2f-0ee7b3f84345 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.547113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f8a05-e4fb-4a67-9b2f-0ee7b3f84345 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.548493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f8a05-e4fb-4a67-9b2f-0ee7b3f84345 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.585156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:27.634249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 506/1004] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:17:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:27.677697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:27.695936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9120375-87a8-41ee-bda9-9c0a59f7d8de None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.739765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.740316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.740595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.740864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.741447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.742849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:27.752681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:27.754075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:27.755399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 499/1005] 10.222.0.61 () {56 vars in 1105 bytes} [Tue Aug 23 16:17:27 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:27.759882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8a05-e4fb-4a67-9b2f-0ee7b3f84345 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:27.866322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f8a05-e4fb-4a67-9b2f-0ee7b3f84345 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.946687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c7046-05e0-4045-b0cf-83fe3280b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.947540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7046-05e0-4045-b0cf-83fe3280b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.947968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7046-05e0-4045-b0cf-83fe3280b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.948410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c7046-05e0-4045-b0cf-83fe3280b3d0 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.949183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c7046-05e0-4045-b0cf-83fe3280b3d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:27.949651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c7046-05e0-4045-b0cf-83fe3280b3d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.951157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c7046-05e0-4045-b0cf-83fe3280b3d0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:27.953145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:27.961639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 507/1006] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:27.963399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:28.074162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78ebe-2541-4be3-b18c-c35d42cf1aa5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:28.109769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c51eea-c6ea-4cd7-bb80-fad435e103e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:28.110521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51eea-c6ea-4cd7-bb80-fad435e103e4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:28.110900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51eea-c6ea-4cd7-bb80-fad435e103e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:28.111267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51eea-c6ea-4cd7-bb80-fad435e103e4 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:28.112030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c51eea-c6ea-4cd7-bb80-fad435e103e4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:28.112429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c51eea-c6ea-4cd7-bb80-fad435e103e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:28.114161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c51eea-c6ea-4cd7-bb80-fad435e103e4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:28.125660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 500/1007] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:29.173249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f3ba-1611-4c5c-a104-578592d3449a None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:29.173816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f3ba-1611-4c5c-a104-578592d3449a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:29.173816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f3ba-1611-4c5c-a104-578592d3449a None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:29.177665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 508/1008] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:29.181947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0ee32-2a02-4486-8784-c1ada2bdbe29 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:29.182452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0ee32-2a02-4486-8784-c1ada2bdbe29 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:29.182531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0ee32-2a02-4486-8784-c1ada2bdbe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:29.204291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-28c0ee32-2a02-4486-8784-c1ada2bdbe29 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:29.205835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-28c0ee32-2a02-4486-8784-c1ada2bdbe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:29.208012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:29.273582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 501/1009] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:29.551341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f332-73f4-4d89-82ad-095c25e9aafd None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:29.551668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f332-73f4-4d89-82ad-095c25e9aafd None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:29.551901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1f332-73f4-4d89-82ad-095c25e9aafd None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:29.552129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0ee32-2a02-4486-8784-c1ada2bdbe29 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:29.553383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 509/1010] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:29.558247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c71bc1-fec6-46f8-8e74-deff11abf3ad None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:29.558538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c71bc1-fec6-46f8-8e74-deff11abf3ad None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:29.558821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c71bc1-fec6-46f8-8e74-deff11abf3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:29.580273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-c2c71bc1-fec6-46f8-8e74-deff11abf3ad None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:29.581469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c2c71bc1-fec6-46f8-8e74-deff11abf3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:29.647221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 510/1011] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:29.664730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0ee32-2a02-4486-8784-c1ada2bdbe29 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:29.699961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:29.700963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:29.701469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:29.701984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:29.702775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:29.704360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:29.713792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:29.714791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:17:29.715664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:29.718345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 502/1012] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:29.724077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c71bc1-fec6-46f8-8e74-deff11abf3ad None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:29.826737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c71bc1-fec6-46f8-8e74-deff11abf3ad None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:29.856097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:29.861883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:29.862492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:29.862774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:29.863039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:29.863672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:29.864235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:29.865657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:29.874580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 511/1013] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:29.876674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:29.879706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:29.915539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:30.000052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20be515-5b42-4e22-8c0f-e5c859313e93 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:30.031189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5bc34-b61f-41f8-8ab9-b3c01bea941b None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:30.036167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c13d1e-8547-496a-9a48-f39091501100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:30.036777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c13d1e-8547-496a-9a48-f39091501100 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.037057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c13d1e-8547-496a-9a48-f39091501100 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.037330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c13d1e-8547-496a-9a48-f39091501100 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.037990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c13d1e-8547-496a-9a48-f39091501100 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:30.038297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c13d1e-8547-496a-9a48-f39091501100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:30.039659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c13d1e-8547-496a-9a48-f39091501100 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:30.044411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 503/1014] 10.222.0.61 () {56 vars in 1112 bytes} [Tue Aug 23 16:17:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:30.045546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a211-9f6e-4e9b-8037-61c044bbdd58 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.045858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a211-9f6e-4e9b-8037-61c044bbdd58 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.046133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74a211-9f6e-4e9b-8037-61c044bbdd58 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.047319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 504/1015] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:30.050170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74a211-9f6e-4e9b-8037-61c044bbdd58 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:30.070231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3cb88-35a7-4bdd-bf1a-264c52ff1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:30.070862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3cb88-35a7-4bdd-bf1a-264c52ff1fea None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.071145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3cb88-35a7-4bdd-bf1a-264c52ff1fea None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.072280 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3cb88-35a7-4bdd-bf1a-264c52ff1fea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.073059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3cb88-35a7-4bdd-bf1a-264c52ff1fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:30.074536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3cb88-35a7-4bdd-bf1a-264c52ff1fea None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:30.076130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 512/1016] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:30.077442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7261-fa92-4bf8-b932-270038f9c54a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.077696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7261-fa92-4bf8-b932-270038f9c54a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.077973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7261-fa92-4bf8-b932-270038f9c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.095611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e8db7261-fa92-4bf8-b932-270038f9c54a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:30.096793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e8db7261-fa92-4bf8-b932-270038f9c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:30.116247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:30.152199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:30.152474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74a211-9f6e-4e9b-8037-61c044bbdd58 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:30.164073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 513/1017] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:30.164868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db7261-fa92-4bf8-b932-270038f9c54a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:30.193012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddfa7b-c8d2-4a28-8f92-b705c9ad5436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:30.193551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfa7b-c8d2-4a28-8f92-b705c9ad5436 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.193816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfa7b-c8d2-4a28-8f92-b705c9ad5436 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.194081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddfa7b-c8d2-4a28-8f92-b705c9ad5436 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.194957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddfa7b-c8d2-4a28-8f92-b705c9ad5436 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:30.196410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddfa7b-c8d2-4a28-8f92-b705c9ad5436 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:30.266562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db7261-fa92-4bf8-b932-270038f9c54a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:30.294646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 505/1018] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:17:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:17:30.311402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444d080-de50-48a2-8be1-2e5bdcaa1253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:30.312025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d080-de50-48a2-8be1-2e5bdcaa1253 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.312303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d080-de50-48a2-8be1-2e5bdcaa1253 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.312569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444d080-de50-48a2-8be1-2e5bdcaa1253 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.313222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444d080-de50-48a2-8be1-2e5bdcaa1253 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:30.314877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444d080-de50-48a2-8be1-2e5bdcaa1253 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:30.403859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 514/1019] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:17:30 2022] POST /identity/v3/projects => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:30.437670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddfa7b-c8d2-4a28-8f92-b705c9ad5436 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:30.555910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddfa7b-c8d2-4a28-8f92-b705c9ad5436 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:30.580058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:30.591729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa51f02-e5f3-4107-b6c7-e23bad147560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:30.592411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f02-e5f3-4107-b6c7-e23bad147560 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.599832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f02-e5f3-4107-b6c7-e23bad147560 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.599832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa51f02-e5f3-4107-b6c7-e23bad147560 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.599832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa51f02-e5f3-4107-b6c7-e23bad147560 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:30.599832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa51f02-e5f3-4107-b6c7-e23bad147560 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:30.711672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 506/1020] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:17:30 2022] POST /identity/v3/services => generated 242 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:32.331578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7da546-4a41-4380-963b-2b0308793e30 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:32.332547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7da546-4a41-4380-963b-2b0308793e30 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:32.333062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7da546-4a41-4380-963b-2b0308793e30 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:32.334917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 515/1021] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:32.339944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bcbe2-eee9-4d08-bd6b-1dda26aaf7c1 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:32.340382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bcbe2-eee9-4d08-bd6b-1dda26aaf7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:32.340551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bcbe2-eee9-4d08-bd6b-1dda26aaf7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:32.358778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b97bcbe2-eee9-4d08-bd6b-1dda26aaf7c1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:32.359960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b97bcbe2-eee9-4d08-bd6b-1dda26aaf7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:32.378369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ed10c-52ce-4968-ba3f-9be60fda9c75 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:32.378649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ed10c-52ce-4968-ba3f-9be60fda9c75 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:32.378929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ed10c-52ce-4968-ba3f-9be60fda9c75 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:32.380383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 516/1022] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:32.385220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa265dd7-d3c4-49c3-acf9-aad427f9db84 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:32.385534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa265dd7-d3c4-49c3-acf9-aad427f9db84 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:32.385817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa265dd7-d3c4-49c3-acf9-aad427f9db84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:32.404379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-fa265dd7-d3c4-49c3-acf9-aad427f9db84 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:32.405474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fa265dd7-d3c4-49c3-acf9-aad427f9db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:32.436989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 507/1023] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:32.446365 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:32.480112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 517/1024] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:32.641034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16474-a482-4add-8e91-de488fe4993e None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:32.641216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16474-a482-4add-8e91-de488fe4993e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:32.641493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e16474-a482-4add-8e91-de488fe4993e None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:32.642913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 508/1025] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:32.648063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52791f04-3018-48b9-8d3b-9a6f2f1a7afe None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:32.648363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52791f04-3018-48b9-8d3b-9a6f2f1a7afe None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:32.648650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52791f04-3018-48b9-8d3b-9a6f2f1a7afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:32.666774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-52791f04-3018-48b9-8d3b-9a6f2f1a7afe None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:32.667965 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-52791f04-3018-48b9-8d3b-9a6f2f1a7afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:32.714060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16474-a482-4add-8e91-de488fe4993e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:32.743392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 518/1026] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:32.747561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52791f04-3018-48b9-8d3b-9a6f2f1a7afe None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:32.821299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e16474-a482-4add-8e91-de488fe4993e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:32.834109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:32.858687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70864a-9b8c-48dc-95e6-1404da7df278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:32.859313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70864a-9b8c-48dc-95e6-1404da7df278 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:32.859588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70864a-9b8c-48dc-95e6-1404da7df278 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:32.859859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70864a-9b8c-48dc-95e6-1404da7df278 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:32.860043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:32.863108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52791f04-3018-48b9-8d3b-9a6f2f1a7afe None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:32.872100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70864a-9b8c-48dc-95e6-1404da7df278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-da70864a-9b8c-48dc-95e6-1404da7df278 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:32.888830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:32.889995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 509/1027] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Aug 23 16:17:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:32.891126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70864a-9b8c-48dc-95e6-1404da7df278 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:32.902637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c015e-0c59-42af-a611-f923859a09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:32.903270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c015e-0c59-42af-a611-f923859a09af None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:32.903550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c015e-0c59-42af-a611-f923859a09af None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:32.903821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c015e-0c59-42af-a611-f923859a09af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:32.905750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c015e-0c59-42af-a611-f923859a09af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:32.911702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c015e-0c59-42af-a611-f923859a09af None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:32.911702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 519/1028] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:32.914366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c015e-0c59-42af-a611-f923859a09af None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:32.997222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70864a-9b8c-48dc-95e6-1404da7df278 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.022521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c015e-0c59-42af-a611-f923859a09af None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.032467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.033073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.033346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.033636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.034311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:33.034609 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.035968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.044057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 510/1029] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Aug 23 16:17:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:33.044884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.060588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1aaea-d540-427a-ba86-1fc88a1d08d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.061198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1aaea-d540-427a-ba86-1fc88a1d08d8 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.061478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1aaea-d540-427a-ba86-1fc88a1d08d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.061785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1aaea-d540-427a-ba86-1fc88a1d08d8 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.062667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1aaea-d540-427a-ba86-1fc88a1d08d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.064011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1aaea-d540-427a-ba86-1fc88a1d08d8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.075302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:33.144915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 520/1030] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:17:32 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:17:33.145339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3d2b-9fc1-4204-bea7-7778d3c0af6f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.146590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1aaea-d540-427a-ba86-1fc88a1d08d8 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.180327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:33.187792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.192536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.192536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.192536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.192536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.192536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:33.201475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:33.203012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:33.204091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 511/1031] 10.222.0.61 () {56 vars in 1105 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:33.209104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.272529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1aaea-d540-427a-ba86-1fc88a1d08d8 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.313952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.314591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.314877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.315155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.325204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:33.328290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.329790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.332316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc297ea4-e685-49c6-8aa1-be571661d4f5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:33.346614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:33.348048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:33.349019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:33.349019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:33.349019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:33.350418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 521/1032] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:33.357455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.377112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.377749 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.378030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.378305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.378935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] RBAC: Adding query filter params (name=image) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:33.379235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.380602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.385582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 512/1033] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:33.391542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.446121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:33.472849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486d05-33f1-45b9-a937-36024436cb5e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.496643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738341a-0fc3-40dd-b8fc-1f4aeb9167cd None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.510546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.511160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.511442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.511723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.512361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:33.512669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.514079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.527002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 522/1034] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:33.532571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.534916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.535528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.535804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.536839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.536839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:33.537016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.538347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.544060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 513/1035] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:33.549693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.575127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:33.639099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb24dc8-e1d9-430c-9a73-6cfb87f8f3d0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.655493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d040bc-b35c-4864-ba16-0c7c49128be6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.675617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.676257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.676537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.676810 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.679962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:33.686220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.687675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.689830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.690450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.695940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.695940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.695940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] RBAC: Adding query filter params (interface=public, service_id=1bbf9619511946ecbecb7ccfa4d26ed4, region_id=RegionOne) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:33.695940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.695940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.699332 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 514/1036] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/endpoints?service_id=1bbf9619511946ecbecb7ccfa4d26ed4&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:33.699732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:33.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:33.706708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 523/1037] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:33.707331 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.707415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.791176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:33.805580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3fd5b-72d6-4288-90e2-38702599ffe0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.820766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29d633-def8-479a-b64a-9c5ae7015717 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:33.842559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05bd6a-59dc-4eec-835a-405768b7a6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.843221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05bd6a-59dc-4eec-835a-405768b7a6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.843602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05bd6a-59dc-4eec-835a-405768b7a6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.843879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05bd6a-59dc-4eec-835a-405768b7a6d6 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.844486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05bd6a-59dc-4eec-835a-405768b7a6d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.845878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05bd6a-59dc-4eec-835a-405768b7a6d6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.861655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 515/1038] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:17:33.861906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:33.861906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:33.861906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:33.861906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:33.862251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:33.862251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:33.862251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:33.881926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 524/1039] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:33.888251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05bd6a-59dc-4eec-835a-405768b7a6d6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:33.998023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05bd6a-59dc-4eec-835a-405768b7a6d6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:34.041065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545fa88-1055-4b6f-a86c-2400ed03968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:34.041714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545fa88-1055-4b6f-a86c-2400ed03968b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:34.041991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545fa88-1055-4b6f-a86c-2400ed03968b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:34.042256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545fa88-1055-4b6f-a86c-2400ed03968b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:34.065759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:34.115766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545fa88-1055-4b6f-a86c-2400ed03968b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:34.117212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545fa88-1055-4b6f-a86c-2400ed03968b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:34.223311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 516/1040] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:17:34.228854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:34.286474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:34.332434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d800889-3ec4-497b-8c2e-616cd7f69461 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:34.366746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:34.367366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:34.367631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:34.367903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:34.378206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:34.379663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:34.394503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:34.395483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:34.396513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:34.396513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:34.396513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:34.396513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 525/1041] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:34.401915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545fa88-1055-4b6f-a86c-2400ed03968b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:34.462503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:34.516284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545fa88-1055-4b6f-a86c-2400ed03968b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:34.550237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:34.550762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:34.551038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:34.551317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:34.551966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:34.552240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:34.553580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:34.565435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 517/1042] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:34.570801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:34.670272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068175c-ff1d-4a11-a11d-2e48bd5dba92 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:34.677184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:34.703377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:34.704003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:34.704281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:34.704550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:34.710964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:34.713055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:34.724734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:34.725933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:34.726973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:34.726973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:34.726973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:34.726973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:34.726973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:34.726973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:34.726973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:34.726973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:34.727847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 526/1043] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:34.732210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:34.834290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac534f63-9b30-445e-9bfd-fb86389bbe80 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:34.845825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:34.870445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ca672-38dc-4a67-a5bd-dae1becc92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:34.871099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca672-38dc-4a67-a5bd-dae1becc92da None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:34.871372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca672-38dc-4a67-a5bd-dae1becc92da None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:34.871633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ca672-38dc-4a67-a5bd-dae1becc92da None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:34.872326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ca672-38dc-4a67-a5bd-dae1becc92da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:34.872628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ca672-38dc-4a67-a5bd-dae1becc92da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:34.874083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ca672-38dc-4a67-a5bd-dae1becc92da None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:34.891411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 518/1044] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:34.892919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:34.995527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b3c37-3b0b-4d9f-83e3-53eed3973bac None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:35.033647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd415684-1c01-4cd7-89a4-2600615820b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:35.034315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415684-1c01-4cd7-89a4-2600615820b3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.034599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415684-1c01-4cd7-89a4-2600615820b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.034875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd415684-1c01-4cd7-89a4-2600615820b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.035604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd415684-1c01-4cd7-89a4-2600615820b3 None admin] RBAC: Adding query filter params (role.id=85aa7bc7e20e41dca9a6c387365d42be, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=33ac116b19864bd694ca089dd5f7e010) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:35.035912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd415684-1c01-4cd7-89a4-2600615820b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:35.037339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd415684-1c01-4cd7-89a4-2600615820b3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:35.049649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 527/1045] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:34 2022] GET /identity/v3/role_assignments?user.id=33ac116b19864bd694ca089dd5f7e010&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=85aa7bc7e20e41dca9a6c387365d42be => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:35.112054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bebff8-a8ce-41a5-b2d0-ed10111cf539 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.112310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bebff8-a8ce-41a5-b2d0-ed10111cf539 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.112539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bebff8-a8ce-41a5-b2d0-ed10111cf539 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.114084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 519/1046] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:35.120141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bcdea-42ee-443a-9bc7-e1efd21680c5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.120431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bcdea-42ee-443a-9bc7-e1efd21680c5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.120703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bcdea-42ee-443a-9bc7-e1efd21680c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.139667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-967bcdea-42ee-443a-9bc7-e1efd21680c5 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:35.140874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-967bcdea-42ee-443a-9bc7-e1efd21680c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:35.166924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:35.213565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 528/1047] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:35.486063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bebff8-a8ce-41a5-b2d0-ed10111cf539 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:35.591286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bebff8-a8ce-41a5-b2d0-ed10111cf539 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:35.626186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e811787-353d-4034-b550-e0179c4d1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:35.626817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811787-353d-4034-b550-e0179c4d1417 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.627100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811787-353d-4034-b550-e0179c4d1417 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.627372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e811787-353d-4034-b550-e0179c4d1417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.638079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e811787-353d-4034-b550-e0179c4d1417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-1e811787-353d-4034-b550-e0179c4d1417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:35.642728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:35.643665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:35.644531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:35.648874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 520/1048] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:17:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:35.650150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bcdea-42ee-443a-9bc7-e1efd21680c5 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:35.750472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bcdea-42ee-443a-9bc7-e1efd21680c5 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:35.785016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffa214-f0c2-4b3a-8eeb-8ce030c2ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:35.785631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffa214-f0c2-4b3a-8eeb-8ce030c2ed51 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.785924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffa214-f0c2-4b3a-8eeb-8ce030c2ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.786199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffa214-f0c2-4b3a-8eeb-8ce030c2ed51 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.786860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffa214-f0c2-4b3a-8eeb-8ce030c2ed51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:35.787162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffa214-f0c2-4b3a-8eeb-8ce030c2ed51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:35.788532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffa214-f0c2-4b3a-8eeb-8ce030c2ed51 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:35.797298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 529/1049] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:17:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:35.802965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e811787-353d-4034-b550-e0179c4d1417 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:35.817772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d667-9bc1-49af-9ec4-464f5a1d16da None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.818070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d667-9bc1-49af-9ec4-464f5a1d16da None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.818463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917d667-9bc1-49af-9ec4-464f5a1d16da None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.819917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 530/1050] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:35.825349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2db9e-af77-4173-aef3-15f7d9dab1ba None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.825654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2db9e-af77-4173-aef3-15f7d9dab1ba None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.825939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2db9e-af77-4173-aef3-15f7d9dab1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.835656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:35.850466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-65c2db9e-af77-4173-aef3-15f7d9dab1ba None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:35.851973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-65c2db9e-af77-4173-aef3-15f7d9dab1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:35.875686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:35.914002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e811787-353d-4034-b550-e0179c4d1417 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:35.927217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 531/1051] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:35.952301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0ae2-7b65-4499-994f-3b69243f5673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:35.952941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0ae2-7b65-4499-994f-3b69243f5673 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.953220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0ae2-7b65-4499-994f-3b69243f5673 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.953494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0ae2-7b65-4499-994f-3b69243f5673 None admin] PATH_INFO: `/v3/users/8ac19829a5ca4fca9d549a6d1fa83f66` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.967631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa0ae2-7b65-4499-994f-3b69243f5673 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac19829a5ca4fca9d549a6d1fa83f66)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:35.969118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa0ae2-7b65-4499-994f-3b69243f5673 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:35.975462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 521/1052] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:35 2022] GET /identity/v3/users/8ac19829a5ca4fca9d549a6d1fa83f66 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:35.977099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2db9e-af77-4173-aef3-15f7d9dab1ba None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:36.088894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2db9e-af77-4173-aef3-15f7d9dab1ba None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:36.125957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0bcd-67bf-41e8-ae35-a3d32dbfe949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:36.126559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0bcd-67bf-41e8-ae35-a3d32dbfe949 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.126836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0bcd-67bf-41e8-ae35-a3d32dbfe949 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.127102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0bcd-67bf-41e8-ae35-a3d32dbfe949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.147905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:36.195094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c0bcd-67bf-41e8-ae35-a3d32dbfe949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:36.196408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0ae2-7b65-4499-994f-3b69243f5673 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:36.196524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c0bcd-67bf-41e8-ae35-a3d32dbfe949 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:36.289223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:36.304720 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 532/1053] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:17:36.304914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0ae2-7b65-4499-994f-3b69243f5673 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:36.305947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0bcd-67bf-41e8-ae35-a3d32dbfe949 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:36.338085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:36.339271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.339569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.339845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] PATH_INFO: `/v3/services/image` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.340428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:36.342740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:36.354093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:36.355147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:36.356019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 522/1054] 10.222.0.61 () {56 vars in 1105 bytes} [Tue Aug 23 16:17:36 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:36.361011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:36.363146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:36.415326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0bcd-67bf-41e8-ae35-a3d32dbfe949 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:36.451154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706675fb-d170-46bc-a06a-798705fbf026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:36.451787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706675fb-d170-46bc-a06a-798705fbf026 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.452182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706675fb-d170-46bc-a06a-798705fbf026 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.452464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706675fb-d170-46bc-a06a-798705fbf026 None admin] PATH_INFO: `/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.453679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706675fb-d170-46bc-a06a-798705fbf026 None admin] RBAC: Authorizing `identity:get_project(project_id=2bce6d67ddd349c8b1bd8a25352376c7)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:36.455120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706675fb-d170-46bc-a06a-798705fbf026 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:36.456767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 533/1055] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:17:36 2022] GET /identity/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:36.463156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706675fb-d170-46bc-a06a-798705fbf026 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:36.467382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817659-4a58-4e5a-91f5-39175c7a4279 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:36.505183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:36.505923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.506449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.506740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.507372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] RBAC: Adding query filter params (name=image) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:36.508000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:36.509405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:36.514618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 523/1056] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:36.519882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:36.541162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:36.570177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706675fb-d170-46bc-a06a-798705fbf026 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:36.591050 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:36.604983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:36.605592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.605906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.606222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.607027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=2bce6d67ddd349c8b1bd8a25352376c7, user.id=8ac19829a5ca4fca9d549a6d1fa83f66) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:36.607341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:36.609811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:36.616115 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 534/1057] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:36 2022] GET /identity/v3/role_assignments?user.id=8ac19829a5ca4fca9d549a6d1fa83f66&scope.project.id=2bce6d67ddd349c8b1bd8a25352376c7&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:36.630610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2dd49-86ca-47f0-97ef-8bf0b3542807 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:36.670249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453b526-3c09-45af-8317-391d9aac2700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:36.670871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b526-3c09-45af-8317-391d9aac2700 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.671151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b526-3c09-45af-8317-391d9aac2700 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.671425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b526-3c09-45af-8317-391d9aac2700 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.672071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b526-3c09-45af-8317-391d9aac2700 None admin] RBAC: Adding query filter params (type=image) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:36.672372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b526-3c09-45af-8317-391d9aac2700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:36.673805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b526-3c09-45af-8317-391d9aac2700 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:36.679879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 524/1058] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:36.685583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:36.795074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1c45-e348-4f52-ac01-4aabe73eb1c0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:36.829968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e73b3-3821-429e-b95f-31c7506da513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:36.830584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e73b3-3821-429e-b95f-31c7506da513 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.830867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e73b3-3821-429e-b95f-31c7506da513 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.831139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e73b3-3821-429e-b95f-31c7506da513 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.831819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e73b3-3821-429e-b95f-31c7506da513 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:36.833206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e73b3-3821-429e-b95f-31c7506da513 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:36.913736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 535/1059] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:17:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:36.944356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb13f-ebc8-4fae-857d-8eb4454bdc48 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.944640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb13f-ebc8-4fae-857d-8eb4454bdc48 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.944924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb13f-ebc8-4fae-857d-8eb4454bdc48 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.946489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 525/1060] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:36.952662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c24bee-218f-4434-9e3a-4058de56596c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:36.952976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c24bee-218f-4434-9e3a-4058de56596c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:36.953223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c24bee-218f-4434-9e3a-4058de56596c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:36.972362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-78c24bee-218f-4434-9e3a-4058de56596c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:36.973592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-78c24bee-218f-4434-9e3a-4058de56596c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:37.012896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:37.064597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 536/1061] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:37.344216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafb13f-ebc8-4fae-857d-8eb4454bdc48 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:37.428289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:37.448809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafb13f-ebc8-4fae-857d-8eb4454bdc48 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:37.483712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093d2a-4fce-47eb-acb3-fc74d61e649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:37.484344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093d2a-4fce-47eb-acb3-fc74d61e649d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:37.484624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093d2a-4fce-47eb-acb3-fc74d61e649d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:37.484895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093d2a-4fce-47eb-acb3-fc74d61e649d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:37.495370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36093d2a-4fce-47eb-acb3-fc74d61e649d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-36093d2a-4fce-47eb-acb3-fc74d61e649d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:37.500005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:37.501354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:37.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:37.505701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 526/1062] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Aug 23 16:17:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:37.507367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c24bee-218f-4434-9e3a-4058de56596c None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:37.607459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c24bee-218f-4434-9e3a-4058de56596c None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:37.642134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:37.642739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:37.643015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:37.643285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:37.643953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:37.644256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:37.645647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:37.654433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 537/1063] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Aug 23 16:17:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:37.660121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093d2a-4fce-47eb-acb3-fc74d61e649d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:37.769210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093d2a-4fce-47eb-acb3-fc74d61e649d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:37.804975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:37.805714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:37.805997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:37.806338 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:37.814846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:37.817356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:37.818983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:37.834089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:37.835039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:37.845063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:37.845063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:37.845063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:37.845063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 527/1064] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:37.845326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:37.873368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:37.964386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a093-3403-4a8b-986d-7d574c9dc43e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:37.998292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:37.998909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:37.999192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:37.999471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.000128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:38.000436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:38.001890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:38.020814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 538/1065] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:38.022671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:38.144287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e03c5-4e37-48f1-ad11-1406f7da819a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:38.180676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:38.181580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.181935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.182268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.190656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:38.192351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:38.204791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:38.205780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:38.211505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 528/1066] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:17:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:38.214375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:38.306096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:38.318699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da7acc-d13f-4574-919f-90717d531b59 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:38.354231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:38.354844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.355124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.355394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.356124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:38.356431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:38.357947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:38.375723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 539/1067] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:17:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:38.381256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:38.436993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:38.488072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066271cd-e04e-4445-9c5a-1084f8c2f597 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:38.524646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5e60-0e7c-477f-8c0c-968a6e244645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:38.525327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5e60-0e7c-477f-8c0c-968a6e244645 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.525560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5e60-0e7c-477f-8c0c-968a6e244645 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.525858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5e60-0e7c-477f-8c0c-968a6e244645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.536703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5e60-0e7c-477f-8c0c-968a6e244645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:38.538342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5e60-0e7c-477f-8c0c-968a6e244645 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-8c6e5e60-0e7c-477f-8c0c-968a6e244645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:38.555324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:38.556926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:38.557901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:38.557901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:38.557901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:38.561941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 529/1068] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:38.564612 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:38.594335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ff92-c40e-4093-a1f4-74c076987a13 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.594618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ff92-c40e-4093-a1f4-74c076987a13 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.594892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ff92-c40e-4093-a1f4-74c076987a13 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.596581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 530/1069] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:38.602043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871f76-07cc-4c8a-8cc4-d9f2de1855d7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.602385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871f76-07cc-4c8a-8cc4-d9f2de1855d7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.602666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb871f76-07cc-4c8a-8cc4-d9f2de1855d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.622548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cb871f76-07cc-4c8a-8cc4-d9f2de1855d7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:38.623725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cb871f76-07cc-4c8a-8cc4-d9f2de1855d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:38.667817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c163d2-126e-4c34-b6e8-e7dc89cb4473 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:38.703800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30507f6d-b845-400b-bce6-28b1ed1104fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:38.704324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507f6d-b845-400b-bce6-28b1ed1104fa None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.704607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507f6d-b845-400b-bce6-28b1ed1104fa None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.704876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507f6d-b845-400b-bce6-28b1ed1104fa None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.705696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30507f6d-b845-400b-bce6-28b1ed1104fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:38.705803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 531/1070] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:38.705884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30507f6d-b845-400b-bce6-28b1ed1104fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:38.707266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30507f6d-b845-400b-bce6-28b1ed1104fa None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:38.719215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 540/1071] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:38.724786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb871f76-07cc-4c8a-8cc4-d9f2de1855d7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:38.758401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:38.823937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb871f76-07cc-4c8a-8cc4-d9f2de1855d7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:38.846902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0a39-bdbd-462e-9a77-be093f13e248 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.847478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0a39-bdbd-462e-9a77-be093f13e248 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.847566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0a39-bdbd-462e-9a77-be093f13e248 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.849210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 541/1072] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:38.854729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422675d3-f381-4ebf-a7ac-00bb9ee193d8 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.855015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422675d3-f381-4ebf-a7ac-00bb9ee193d8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.855292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422675d3-f381-4ebf-a7ac-00bb9ee193d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.860064 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:38.860706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.860989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.861267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.872092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:38.872791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:38.874350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:38.878556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-422675d3-f381-4ebf-a7ac-00bb9ee193d8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:38.879767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-422675d3-f381-4ebf-a7ac-00bb9ee193d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:38.886797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:38.887713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:38.888634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 532/1073] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:38.893955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:38.961716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 542/1074] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:38.984302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422675d3-f381-4ebf-a7ac-00bb9ee193d8 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:38.993402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:39.001650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f3b02-fa34-4e3a-9cfa-c95b63d89db4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.041092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.042154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.042544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.042858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.043610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:39.043936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.045584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.061077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 533/1075] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:39.067863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:39.099055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422675d3-f381-4ebf-a7ac-00bb9ee193d8 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.136013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea59d6-1941-45a4-9cfd-c539ef8f4c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.136750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea59d6-1941-45a4-9cfd-c539ef8f4c68 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.137030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea59d6-1941-45a4-9cfd-c539ef8f4c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.137300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea59d6-1941-45a4-9cfd-c539ef8f4c68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.140703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:39.148853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea59d6-1941-45a4-9cfd-c539ef8f4c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b3ea59d6-1941-45a4-9cfd-c539ef8f4c68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:39.154533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:39.155484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:39.156378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 543/1076] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:39.161498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea59d6-1941-45a4-9cfd-c539ef8f4c68 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:39.178503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287d08d-6c2d-4897-af56-bb9c19789cfb None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.213480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ca709-3a42-4f73-9240-5db3cb8a701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.214090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ca709-3a42-4f73-9240-5db3cb8a701c None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.214357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ca709-3a42-4f73-9240-5db3cb8a701c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.214646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ca709-3a42-4f73-9240-5db3cb8a701c None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/33ac116b19864bd694ca089dd5f7e010/roles/85aa7bc7e20e41dca9a6c387365d42be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.216845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ca709-3a42-4f73-9240-5db3cb8a701c None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=33ac116b19864bd694ca089dd5f7e010, role_id=85aa7bc7e20e41dca9a6c387365d42be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.218316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ca709-3a42-4f73-9240-5db3cb8a701c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.271171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea59d6-1941-45a4-9cfd-c539ef8f4c68 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.307023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.307616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.307898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.308168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.308824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:39.309125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.310522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.319137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 544/1077] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:39.320585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:39.328972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 534/1078] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:17:39 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/33ac116b19864bd694ca089dd5f7e010/roles/85aa7bc7e20e41dca9a6c387365d42be => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:17:39.330426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ca709-3a42-4f73-9240-5db3cb8a701c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:39.349085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:39.398786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:39.444235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe54ff7-7848-4bfe-9f7b-182681cb4f51 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.447926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ca709-3a42-4f73-9240-5db3cb8a701c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.486985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd671e5-141e-45ee-81da-4076c6ef2253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.487518 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd671e5-141e-45ee-81da-4076c6ef2253 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.487795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd671e5-141e-45ee-81da-4076c6ef2253 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.488070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd671e5-141e-45ee-81da-4076c6ef2253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.494771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583b54-ae9d-4912-bba2-a424440e16f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.495782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583b54-ae9d-4912-bba2-a424440e16f5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.496310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583b54-ae9d-4912-bba2-a424440e16f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.496800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c583b54-ae9d-4912-bba2-a424440e16f5 None admin] PATH_INFO: `/v3/users/8ac19829a5ca4fca9d549a6d1fa83f66` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.498298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c583b54-ae9d-4912-bba2-a424440e16f5 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac19829a5ca4fca9d549a6d1fa83f66)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.500184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c583b54-ae9d-4912-bba2-a424440e16f5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.502646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 535/1079] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:39 2022] GET /identity/v3/users/8ac19829a5ca4fca9d549a6d1fa83f66 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:39.508086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583b54-ae9d-4912-bba2-a424440e16f5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:39.568744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd671e5-141e-45ee-81da-4076c6ef2253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.572017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd671e5-141e-45ee-81da-4076c6ef2253 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.597241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:39.617754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c583b54-ae9d-4912-bba2-a424440e16f5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.648921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:39.654566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e37f46-8ff8-4b49-ad4a-4c7eaaf75071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.655190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e37f46-8ff8-4b49-ad4a-4c7eaaf75071 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.655515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e37f46-8ff8-4b49-ad4a-4c7eaaf75071 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.655748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e37f46-8ff8-4b49-ad4a-4c7eaaf75071 None admin] PATH_INFO: `/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.657259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e37f46-8ff8-4b49-ad4a-4c7eaaf75071 None admin] RBAC: Authorizing `identity:get_project(project_id=2bce6d67ddd349c8b1bd8a25352376c7)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.658325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e37f46-8ff8-4b49-ad4a-4c7eaaf75071 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.662562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 536/1080] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:17:39 2022] GET /identity/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:39.666368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e37f46-8ff8-4b49-ad4a-4c7eaaf75071 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:39.693632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 545/1081] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:17:39.699342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd671e5-141e-45ee-81da-4076c6ef2253 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:39.779649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e37f46-8ff8-4b49-ad4a-4c7eaaf75071 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.810792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd671e5-141e-45ee-81da-4076c6ef2253 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.816052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df132f-9f5f-4b71-b452-2bf951d8624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.816715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df132f-9f5f-4b71-b452-2bf951d8624d None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.816995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df132f-9f5f-4b71-b452-2bf951d8624d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.817273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df132f-9f5f-4b71-b452-2bf951d8624d None admin] PATH_INFO: `/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7/users/8ac19829a5ca4fca9d549a6d1fa83f66/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.819248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df132f-9f5f-4b71-b452-2bf951d8624d None admin] RBAC: Authorizing `identity:create_grant(project_id=2bce6d67ddd349c8b1bd8a25352376c7, user_id=8ac19829a5ca4fca9d549a6d1fa83f66, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.820707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df132f-9f5f-4b71-b452-2bf951d8624d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.846187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.846819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.847103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.847702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.857872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.859297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:39.875206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:39.876509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:39.877441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:39.877441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:39.877441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:39.877441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 546/1082] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:39.882265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:39.891456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 537/1083] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:17:39 2022] PUT /identity/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7/users/8ac19829a5ca4fca9d549a6d1fa83f66/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:17:39.898139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:40.009747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728664d-48ee-4301-a8e7-774ac94cb484 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:40.057244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d716b6-88e6-451f-b6e7-7627851aabde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:40.058327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d716b6-88e6-451f-b6e7-7627851aabde None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:40.058575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d716b6-88e6-451f-b6e7-7627851aabde None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:40.058847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d716b6-88e6-451f-b6e7-7627851aabde None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:40.059497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d716b6-88e6-451f-b6e7-7627851aabde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:40.059798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d716b6-88e6-451f-b6e7-7627851aabde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:40.061172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d716b6-88e6-451f-b6e7-7627851aabde None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:40.074068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 547/1084] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:41.274639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24892b-dae6-4e8d-b9bc-b250f4baf240 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:41.275221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24892b-dae6-4e8d-b9bc-b250f4baf240 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:41.275221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24892b-dae6-4e8d-b9bc-b250f4baf240 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:41.276574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 538/1085] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:41.281917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fad32e-656e-4fa3-af71-5fedb5d39def None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:41.282358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fad32e-656e-4fa3-af71-5fedb5d39def None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:41.282621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fad32e-656e-4fa3-af71-5fedb5d39def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:41.300653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d3fad32e-656e-4fa3-af71-5fedb5d39def None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:41.301891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d3fad32e-656e-4fa3-af71-5fedb5d39def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:41.363346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:41.368247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 548/1086] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:41.635668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24892b-dae6-4e8d-b9bc-b250f4baf240 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:41.647732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:41.734993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24892b-dae6-4e8d-b9bc-b250f4baf240 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:41.767897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bddd05-ab71-4dd4-bf4e-faf649e37f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:41.768510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddd05-ab71-4dd4-bf4e-faf649e37f64 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:41.768785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddd05-ab71-4dd4-bf4e-faf649e37f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:41.769053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddd05-ab71-4dd4-bf4e-faf649e37f64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:41.779288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bddd05-ab71-4dd4-bf4e-faf649e37f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-f1bddd05-ab71-4dd4-bf4e-faf649e37f64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:41.783842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:41.784972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:41.785929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 539/1087] 10.222.0.61 () {56 vars in 1120 bytes} [Tue Aug 23 16:17:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:41.790921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fad32e-656e-4fa3-af71-5fedb5d39def None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:41.827685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992d30-2085-4fe7-99b6-552010ed76c0 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:41.827973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992d30-2085-4fe7-99b6-552010ed76c0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:41.828249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992d30-2085-4fe7-99b6-552010ed76c0 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:41.829566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 540/1088] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:17:41.834525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe638d41-765a-480d-b2a2-c304fb998dc7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:41.834811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe638d41-765a-480d-b2a2-c304fb998dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:41.835092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe638d41-765a-480d-b2a2-c304fb998dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:41.853487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fe638d41-765a-480d-b2a2-c304fb998dc7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:41.854715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fe638d41-765a-480d-b2a2-c304fb998dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:41.889171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fad32e-656e-4fa3-af71-5fedb5d39def None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:41.918869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:41.922909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:41.923517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:41.923657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 541/1089] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:17:41.923915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:41.924168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:41.924862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:41.925167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:41.926569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:41.939224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 549/1090] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Aug 23 16:17:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:41.940298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe638d41-765a-480d-b2a2-c304fb998dc7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.037732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe638d41-765a-480d-b2a2-c304fb998dc7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.071261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.072433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.072712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.072984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.082982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:42.084410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:42.099995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:42.100914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:42.102174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:42.102174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:42.102174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:42.102174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 542/1091] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:17:42.106901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.168194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:42.193317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.206929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feadd4-c623-4689-b357-50dd4057e1d2 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.240883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.241480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.241787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.242057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.242688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:42.242985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:42.244864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:42.246670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:42.256284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 550/1092] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:42.262685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.293441 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b02c2-5940-4797-b474-ef37b25c2a74 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.327648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141d50-d710-4456-a6db-d9f107a5e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.328269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141d50-d710-4456-a6db-d9f107a5e01f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.328546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141d50-d710-4456-a6db-d9f107a5e01f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.328814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141d50-d710-4456-a6db-d9f107a5e01f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.338661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59141d50-d710-4456-a6db-d9f107a5e01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-59141d50-d710-4456-a6db-d9f107a5e01f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:17:42.343695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:42.344843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:17:42.346108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 543/1093] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:42.350595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141d50-d710-4456-a6db-d9f107a5e01f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.364761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aabc66-e3a3-40fe-a9d7-50d084413e95 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.387789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:42.399604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.400271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.400546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.400814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] PATH_INFO: `/v3/users/nova` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.407990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:42.409421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:17:42.421408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:42.422566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:42.423548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 551/1094] 10.222.0.61 () {56 vars in 1093 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:42.428240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.450506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141d50-d710-4456-a6db-d9f107a5e01f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.462855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:42.483246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.483841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.484116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.484390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.485041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:42.485337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:42.486770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:42.496650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 544/1095] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:42.502467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.527064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e5bb9-f97a-4375-9e61-2e6ba4524fba None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.562816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.563420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.563700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.563969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.564689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:42.564995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:42.566457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:42.583324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 552/1096] 10.222.0.61 () {56 vars in 1133 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:42.589060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.606203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da8ad9-6405-4ff5-acd8-8993a1f13952 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.630081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:42.640483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430ece-d89d-4727-a8b7-a5d0d9ac46e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.641102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430ece-d89d-4727-a8b7-a5d0d9ac46e7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.641375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430ece-d89d-4727-a8b7-a5d0d9ac46e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.641876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430ece-d89d-4727-a8b7-a5d0d9ac46e7 None admin] PATH_INFO: `/v3/users/8ac19829a5ca4fca9d549a6d1fa83f66` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.642991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11430ece-d89d-4727-a8b7-a5d0d9ac46e7 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac19829a5ca4fca9d549a6d1fa83f66)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:42.644399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11430ece-d89d-4727-a8b7-a5d0d9ac46e7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:42.645996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 545/1097] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/users/8ac19829a5ca4fca9d549a6d1fa83f66 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:42.651858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430ece-d89d-4727-a8b7-a5d0d9ac46e7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.687349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253b1d9-ba21-4946-9204-03a75e86adb2 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.694332 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:42.720975 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f621c82-6f57-4d3b-bd5a-df959d6ab95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.721587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f621c82-6f57-4d3b-bd5a-df959d6ab95a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.721896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f621c82-6f57-4d3b-bd5a-df959d6ab95a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.722172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f621c82-6f57-4d3b-bd5a-df959d6ab95a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.749711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430ece-d89d-4727-a8b7-a5d0d9ac46e7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:42.782536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878415c-03a5-406d-8264-9ca142909bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:42.783126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878415c-03a5-406d-8264-9ca142909bfd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:42.783410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878415c-03a5-406d-8264-9ca142909bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:42.783682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878415c-03a5-406d-8264-9ca142909bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:42.788428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f621c82-6f57-4d3b-bd5a-df959d6ab95a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:42.789905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f621c82-6f57-4d3b-bd5a-df959d6ab95a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:42.829560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:42.849879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878415c-03a5-406d-8264-9ca142909bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:42.851321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878415c-03a5-406d-8264-9ca142909bfd None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:42.888886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 553/1098] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:17:42.894583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f621c82-6f57-4d3b-bd5a-df959d6ab95a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.897331 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:42.953909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 546/1099] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:17:42.959672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878415c-03a5-406d-8264-9ca142909bfd None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:42.990328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f621c82-6f57-4d3b-bd5a-df959d6ab95a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:43.022297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:43.022909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.023190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.023487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.032656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:43.034920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:43.036371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:17:43.051309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:43.052475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:17:43.053755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:17:43.053755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:17:43.053755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:43.053755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 554/1100] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:43.058437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:43.062231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878415c-03a5-406d-8264-9ca142909bfd None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:43.096059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961dfac-6044-48dc-af96-58dd6263f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:43.096687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961dfac-6044-48dc-af96-58dd6263f722 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.096967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961dfac-6044-48dc-af96-58dd6263f722 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.097241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961dfac-6044-48dc-af96-58dd6263f722 None admin] PATH_INFO: `/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.098386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961dfac-6044-48dc-af96-58dd6263f722 None admin] RBAC: Authorizing `identity:get_project(project_id=2bce6d67ddd349c8b1bd8a25352376c7)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:43.099807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961dfac-6044-48dc-af96-58dd6263f722 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:43.101424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 547/1101] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:17:42 2022] GET /identity/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:43.108016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961dfac-6044-48dc-af96-58dd6263f722 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:43.119560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:43.158052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121133d-2322-48c2-be3a-20c330d0f6c2 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:43.191230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:43.191835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.192113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.192374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.193011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:43.193307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:43.194701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:43.206943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 555/1102] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:43.210297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961dfac-6044-48dc-af96-58dd6263f722 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:43.212925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:43.245752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:43.246347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.246623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.246889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.247604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=2bce6d67ddd349c8b1bd8a25352376c7, user.id=8ac19829a5ca4fca9d549a6d1fa83f66) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:43.247904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:43.249311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:43.254966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 548/1103] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:43 2022] GET /identity/v3/role_assignments?user.id=8ac19829a5ca4fca9d549a6d1fa83f66&scope.project.id=2bce6d67ddd349c8b1bd8a25352376c7&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:17:43.272151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:43.323972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaa5fb-d3ce-4a8e-8c24-d5b23dca214b None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:43.358581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:43.359314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.359622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.359980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.372980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:43.375852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:17:43.389126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:17:43.390347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:17:43.391343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 556/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:17:43.397100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:43.471624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:43.496020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64885c-e6d3-4481-87a4-b2e0efd0a2a3 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:43.529953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2818d-7bf5-4e64-863d-ff1354614bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:43.530560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2818d-7bf5-4e64-863d-ff1354614bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.530843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2818d-7bf5-4e64-863d-ff1354614bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.531119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2818d-7bf5-4e64-863d-ff1354614bf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.531815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2818d-7bf5-4e64-863d-ff1354614bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:43.532120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2818d-7bf5-4e64-863d-ff1354614bf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:43.533551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2818d-7bf5-4e64-863d-ff1354614bf5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:43.545405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 549/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:43.551653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:43.651307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d8c40-b341-4084-bb9b-a0d589b96f25 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:43.673003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:43.694623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d34d5-5fa7-4d68-b659-ea89c9daeaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:43.695232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d34d5-5fa7-4d68-b659-ea89c9daeaca None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.695517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d34d5-5fa7-4d68-b659-ea89c9daeaca None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.695791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d34d5-5fa7-4d68-b659-ea89c9daeaca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.696515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d34d5-5fa7-4d68-b659-ea89c9daeaca None admin] RBAC: Adding query filter params (role.id=85aa7bc7e20e41dca9a6c387365d42be, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=33ac116b19864bd694ca089dd5f7e010) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:43.697394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d34d5-5fa7-4d68-b659-ea89c9daeaca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:43.698869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d34d5-5fa7-4d68-b659-ea89c9daeaca None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:43.704789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 557/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:43 2022] GET /identity/v3/role_assignments?user.id=33ac116b19864bd694ca089dd5f7e010&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=85aa7bc7e20e41dca9a6c387365d42be => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:45.178641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4eed3-b867-4708-9ae6-da330e3b12e9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:45.179135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4eed3-b867-4708-9ae6-da330e3b12e9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:45.179254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4eed3-b867-4708-9ae6-da330e3b12e9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:45.180531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 550/1107] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:45.186197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c038-3c07-4620-a172-3203c321bf10 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:45.186625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c038-3c07-4620-a172-3203c321bf10 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:45.186746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c038-3c07-4620-a172-3203c321bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:45.204652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4e98c038-3c07-4620-a172-3203c321bf10 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:45.205855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4e98c038-3c07-4620-a172-3203c321bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:45.273445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 558/1108] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:45.539501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4eed3-b867-4708-9ae6-da330e3b12e9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:45.637181 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4eed3-b867-4708-9ae6-da330e3b12e9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:45.669398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b842d-93b0-4fd0-b48f-4baba6f0e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:45.670035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b842d-93b0-4fd0-b48f-4baba6f0e2ef None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:45.670317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b842d-93b0-4fd0-b48f-4baba6f0e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:45.670590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b842d-93b0-4fd0-b48f-4baba6f0e2ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:45.671686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b842d-93b0-4fd0-b48f-4baba6f0e2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:45.673103 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b842d-93b0-4fd0-b48f-4baba6f0e2ef None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:45.674656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 551/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:45.680188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98c038-3c07-4620-a172-3203c321bf10 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:45.775805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98c038-3c07-4620-a172-3203c321bf10 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:45.782848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:45.808926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8569c-5d07-465f-971d-2d6f5e5cc8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:45.809493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8569c-5d07-465f-971d-2d6f5e5cc8e7 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:45.809808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8569c-5d07-465f-971d-2d6f5e5cc8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:45.810087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8569c-5d07-465f-971d-2d6f5e5cc8e7 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:45.810724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8569c-5d07-465f-971d-2d6f5e5cc8e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:45.812154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8569c-5d07-465f-971d-2d6f5e5cc8e7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:45.898636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 559/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:17:45 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:47.831833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e0f1-bd1b-4cb6-92e2-2089ffd865e0 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:47.832374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e0f1-bd1b-4cb6-92e2-2089ffd865e0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:47.832374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e0f1-bd1b-4cb6-92e2-2089ffd865e0 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:47.833738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 552/1111] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:47.839496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ee5f8-522d-4f9d-952c-b04e229d3513 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:47.839911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ee5f8-522d-4f9d-952c-b04e229d3513 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:47.840052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ee5f8-522d-4f9d-952c-b04e229d3513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:47.857575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8b0ee5f8-522d-4f9d-952c-b04e229d3513 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:47.858783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8b0ee5f8-522d-4f9d-952c-b04e229d3513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:47.922912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 560/1112] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:48.194267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e0f1-bd1b-4cb6-92e2-2089ffd865e0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:48.197664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:48.292133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e0f1-bd1b-4cb6-92e2-2089ffd865e0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:48.325732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c74c4-2758-4fc8-82ab-9550cdca3c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:48.326348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c74c4-2758-4fc8-82ab-9550cdca3c21 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:48.326628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c74c4-2758-4fc8-82ab-9550cdca3c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:48.326900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c74c4-2758-4fc8-82ab-9550cdca3c21 None admin] PATH_INFO: `/v3/roles/0e7d21c594094cef90457df82be0bce6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:48.328267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c74c4-2758-4fc8-82ab-9550cdca3c21 None admin] RBAC: Authorizing `identity:get_role(role_id=0e7d21c594094cef90457df82be0bce6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:48.329630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c74c4-2758-4fc8-82ab-9550cdca3c21 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:48.331598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 553/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:48 2022] GET /identity/v3/roles/0e7d21c594094cef90457df82be0bce6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:48.337728 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ee5f8-522d-4f9d-952c-b04e229d3513 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:48.429213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:48.438046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ee5f8-522d-4f9d-952c-b04e229d3513 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:48.471236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda4c1-6eab-46ff-ab70-0e9f16752bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:48.471797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda4c1-6eab-46ff-ab70-0e9f16752bbd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:48.472081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda4c1-6eab-46ff-ab70-0e9f16752bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:48.472353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda4c1-6eab-46ff-ab70-0e9f16752bbd None admin] PATH_INFO: `/v3/users/9d052e925422415a81aa9cd367c0d062` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:48.485547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda4c1-6eab-46ff-ab70-0e9f16752bbd None admin] RBAC: Authorizing `identity:get_user(user_id=9d052e925422415a81aa9cd367c0d062)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:48.487005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda4c1-6eab-46ff-ab70-0e9f16752bbd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:48.488603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 561/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:48 2022] GET /identity/v3/users/9d052e925422415a81aa9cd367c0d062 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:48.495125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c74c4-2758-4fc8-82ab-9550cdca3c21 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:48.562083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:48.590509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c74c4-2758-4fc8-82ab-9550cdca3c21 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:48.624420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d544d-ce05-48cf-8736-6e662b8bfe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:48.625236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d544d-ce05-48cf-8736-6e662b8bfe97 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:48.625755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d544d-ce05-48cf-8736-6e662b8bfe97 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:48.626231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d544d-ce05-48cf-8736-6e662b8bfe97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:48.691584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d544d-ce05-48cf-8736-6e662b8bfe97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:48.693026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d544d-ce05-48cf-8736-6e662b8bfe97 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:48.758147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:48.792173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 554/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:17:48.797929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda4c1-6eab-46ff-ab70-0e9f16752bbd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:48.893896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda4c1-6eab-46ff-ab70-0e9f16752bbd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:48.926739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381fc15-f0c7-435f-b71b-1855b145a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:48.927347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381fc15-f0c7-435f-b71b-1855b145a3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:48.927623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381fc15-f0c7-435f-b71b-1855b145a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:48.927895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381fc15-f0c7-435f-b71b-1855b145a3b1 None admin] PATH_INFO: `/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:48.928990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381fc15-f0c7-435f-b71b-1855b145a3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=2bce6d67ddd349c8b1bd8a25352376c7)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:48.930435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381fc15-f0c7-435f-b71b-1855b145a3b1 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:48.932044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 562/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:17:48 2022] GET /identity/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:48.938065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d544d-ce05-48cf-8736-6e662b8bfe97 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:49.037954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d544d-ce05-48cf-8736-6e662b8bfe97 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:49.071077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f6c8a-d503-4d22-b088-6cf803b4700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:49.071672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6c8a-d503-4d22-b088-6cf803b4700a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:49.071953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6c8a-d503-4d22-b088-6cf803b4700a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:49.072224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f6c8a-d503-4d22-b088-6cf803b4700a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:49.072944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f6c8a-d503-4d22-b088-6cf803b4700a None admin] RBAC: Adding query filter params (role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=2bce6d67ddd349c8b1bd8a25352376c7, user.id=9d052e925422415a81aa9cd367c0d062) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:49.073251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f6c8a-d503-4d22-b088-6cf803b4700a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:49.074701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f6c8a-d503-4d22-b088-6cf803b4700a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:49.080045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 555/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:48 2022] GET /identity/v3/role_assignments?user.id=9d052e925422415a81aa9cd367c0d062&scope.project.id=2bce6d67ddd349c8b1bd8a25352376c7&role.id=0e7d21c594094cef90457df82be0bce6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:50.940379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9db3-261d-4512-a25f-f0e1de1684a3 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:50.941036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9db3-261d-4512-a25f-f0e1de1684a3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:50.941036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9db3-261d-4512-a25f-f0e1de1684a3 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:50.942283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 563/1118] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:50.947480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb154-a55a-495c-a1ce-a644518c7e6e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:50.947946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb154-a55a-495c-a1ce-a644518c7e6e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:50.948055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdb154-a55a-495c-a1ce-a644518c7e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:50.965477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6bbdb154-a55a-495c-a1ce-a644518c7e6e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:50.966685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6bbdb154-a55a-495c-a1ce-a644518c7e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:50.992798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:51.031521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 556/1119] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:51.300331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc9db3-261d-4512-a25f-f0e1de1684a3 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:51.318776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:51.398729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc9db3-261d-4512-a25f-f0e1de1684a3 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:51.431904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b85e82-efd9-4fcc-a58c-874e65f34ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:51.432554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b85e82-efd9-4fcc-a58c-874e65f34ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:51.432837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b85e82-efd9-4fcc-a58c-874e65f34ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:51.433112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b85e82-efd9-4fcc-a58c-874e65f34ed4 None admin] PATH_INFO: `/v3/roles/0e7d21c594094cef90457df82be0bce6` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:51.434525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b85e82-efd9-4fcc-a58c-874e65f34ed4 None admin] RBAC: Authorizing `identity:get_role(role_id=0e7d21c594094cef90457df82be0bce6)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:51.435897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b85e82-efd9-4fcc-a58c-874e65f34ed4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:51.437199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 564/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:51 2022] GET /identity/v3/roles/0e7d21c594094cef90457df82be0bce6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:51.443037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb154-a55a-495c-a1ce-a644518c7e6e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:51.538856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdb154-a55a-495c-a1ce-a644518c7e6e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:51.571435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4e5db-f09f-40ec-ab4f-909707e074c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:51.572577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4e5db-f09f-40ec-ab4f-909707e074c6 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:51.572857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4e5db-f09f-40ec-ab4f-909707e074c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:51.573131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4e5db-f09f-40ec-ab4f-909707e074c6 None admin] PATH_INFO: `/v3/users/9d052e925422415a81aa9cd367c0d062` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:51.574252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4e5db-f09f-40ec-ab4f-909707e074c6 None admin] RBAC: Authorizing `identity:get_user(user_id=9d052e925422415a81aa9cd367c0d062)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:51.575674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4e5db-f09f-40ec-ab4f-909707e074c6 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:51.577226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 557/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:51 2022] GET /identity/v3/users/9d052e925422415a81aa9cd367c0d062 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:51.582983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b85e82-efd9-4fcc-a58c-874e65f34ed4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:51.664702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:51.678704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b85e82-efd9-4fcc-a58c-874e65f34ed4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:51.711076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30073c9a-0eae-4c45-885a-fa0e233710ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:51.711687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073c9a-0eae-4c45-885a-fa0e233710ac None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:51.711968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073c9a-0eae-4c45-885a-fa0e233710ac None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:51.712242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30073c9a-0eae-4c45-885a-fa0e233710ac None admin] PATH_INFO: `/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:51.713982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30073c9a-0eae-4c45-885a-fa0e233710ac None admin] RBAC: Authorizing `identity:get_project(project_id=2bce6d67ddd349c8b1bd8a25352376c7)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:51.715402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30073c9a-0eae-4c45-885a-fa0e233710ac None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:51.717010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 565/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:17:51 2022] GET /identity/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:51.722740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4e5db-f09f-40ec-ab4f-909707e074c6 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:51.752756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:51.819784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4e5db-f09f-40ec-ab4f-909707e074c6 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:51.853011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2e039-5776-4c0b-b7bb-5a3fdee02c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:51.853643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e039-5776-4c0b-b7bb-5a3fdee02c0e None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:51.853980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e039-5776-4c0b-b7bb-5a3fdee02c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:51.854255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2e039-5776-4c0b-b7bb-5a3fdee02c0e None admin] PATH_INFO: `/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7/users/9d052e925422415a81aa9cd367c0d062/roles/0e7d21c594094cef90457df82be0bce6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:51.856388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2e039-5776-4c0b-b7bb-5a3fdee02c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=2bce6d67ddd349c8b1bd8a25352376c7, user_id=9d052e925422415a81aa9cd367c0d062, role_id=0e7d21c594094cef90457df82be0bce6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:51.857851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2e039-5776-4c0b-b7bb-5a3fdee02c0e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:51.904751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 558/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:17:51 2022] PUT /identity/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7/users/9d052e925422415a81aa9cd367c0d062/roles/0e7d21c594094cef90457df82be0bce6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:17:53.763067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ff33-a566-4913-b745-72a7a8e9ba71 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:53.763637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ff33-a566-4913-b745-72a7a8e9ba71 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:53.763637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4ff33-a566-4913-b745-72a7a8e9ba71 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:53.764954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 566/1124] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:53.770045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2f49-4abd-4a20-8c03-a4d931815818 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:53.770487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2f49-4abd-4a20-8c03-a4d931815818 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:53.770590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2f49-4abd-4a20-8c03-a4d931815818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:53.788221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-abab2f49-4abd-4a20-8c03-a4d931815818 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:53.789409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-abab2f49-4abd-4a20-8c03-a4d931815818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:53.854264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 559/1125] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:54.125014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4ff33-a566-4913-b745-72a7a8e9ba71 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:54.222357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4ff33-a566-4913-b745-72a7a8e9ba71 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:54.255089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1c115-6c3f-4399-852d-4ce8000450af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:54.255710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1c115-6c3f-4399-852d-4ce8000450af None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:54.255987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1c115-6c3f-4399-852d-4ce8000450af None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:54.256258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1c115-6c3f-4399-852d-4ce8000450af None admin] PATH_INFO: `/v3/roles/0e7d21c594094cef90457df82be0bce6` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:54.257649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1c115-6c3f-4399-852d-4ce8000450af None admin] RBAC: Authorizing `identity:get_role(role_id=0e7d21c594094cef90457df82be0bce6)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:54.259024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1c115-6c3f-4399-852d-4ce8000450af None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:54.260357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 567/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:54 2022] GET /identity/v3/roles/0e7d21c594094cef90457df82be0bce6 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:54.266140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2f49-4abd-4a20-8c03-a4d931815818 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:54.290202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:54.364574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2f49-4abd-4a20-8c03-a4d931815818 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:54.396686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43523-8bc3-42d5-9137-f5d4bbd41ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:54.397301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43523-8bc3-42d5-9137-f5d4bbd41ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:54.397579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43523-8bc3-42d5-9137-f5d4bbd41ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:54.397877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43523-8bc3-42d5-9137-f5d4bbd41ad1 None admin] PATH_INFO: `/v3/users/9d052e925422415a81aa9cd367c0d062` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:54.398976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e43523-8bc3-42d5-9137-f5d4bbd41ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=9d052e925422415a81aa9cd367c0d062)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:54.400901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e43523-8bc3-42d5-9137-f5d4bbd41ad1 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:54.402482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 560/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:17:54 2022] GET /identity/v3/users/9d052e925422415a81aa9cd367c0d062 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:54.408312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1c115-6c3f-4399-852d-4ce8000450af None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:54.432696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:54.504802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1c115-6c3f-4399-852d-4ce8000450af None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:54.536677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c17c5-57ee-4fde-b4e9-ebf798467ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:54.537262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c17c5-57ee-4fde-b4e9-ebf798467ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:54.537541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c17c5-57ee-4fde-b4e9-ebf798467ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:54.537838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c17c5-57ee-4fde-b4e9-ebf798467ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:54.601520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c17c5-57ee-4fde-b4e9-ebf798467ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:54.602976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c17c5-57ee-4fde-b4e9-ebf798467ce0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:54.630472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:54.705863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 568/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:17:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:17:54.712016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43523-8bc3-42d5-9137-f5d4bbd41ad1 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:54.800382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:54.809562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43523-8bc3-42d5-9137-f5d4bbd41ad1 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:54.843300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dda78d-b81e-46d5-9a8a-e4727408a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:54.843907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dda78d-b81e-46d5-9a8a-e4727408a60d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:54.844183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dda78d-b81e-46d5-9a8a-e4727408a60d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:54.844453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dda78d-b81e-46d5-9a8a-e4727408a60d None admin] PATH_INFO: `/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:54.845541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dda78d-b81e-46d5-9a8a-e4727408a60d None admin] RBAC: Authorizing `identity:get_project(project_id=2bce6d67ddd349c8b1bd8a25352376c7)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:54.846977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dda78d-b81e-46d5-9a8a-e4727408a60d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:54.848565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 561/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:17:54 2022] GET /identity/v3/projects/2bce6d67ddd349c8b1bd8a25352376c7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:54.854766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c17c5-57ee-4fde-b4e9-ebf798467ce0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:54.949322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c17c5-57ee-4fde-b4e9-ebf798467ce0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:54.970045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:54.981199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70baf504-6671-4cb8-89a8-388b4235be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:54.987925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf504-6671-4cb8-89a8-388b4235be87 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:54.987925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf504-6671-4cb8-89a8-388b4235be87 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:54.987925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70baf504-6671-4cb8-89a8-388b4235be87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:54.987925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baf504-6671-4cb8-89a8-388b4235be87 None admin] RBAC: Adding query filter params (role.id=0e7d21c594094cef90457df82be0bce6, scope.project.id=2bce6d67ddd349c8b1bd8a25352376c7, user.id=9d052e925422415a81aa9cd367c0d062) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:17:54.987925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baf504-6671-4cb8-89a8-388b4235be87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:54.987925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70baf504-6671-4cb8-89a8-388b4235be87 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:54.991443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 569/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:17:54 2022] GET /identity/v3/role_assignments?user.id=9d052e925422415a81aa9cd367c0d062&scope.project.id=2bce6d67ddd349c8b1bd8a25352376c7&role.id=0e7d21c594094cef90457df82be0bce6 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:56.911961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925387c6-359f-47fc-9e72-76f7742df92c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:56.912529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925387c6-359f-47fc-9e72-76f7742df92c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:56.912529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925387c6-359f-47fc-9e72-76f7742df92c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:56.913904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 562/1131] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:56.919217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6ee0-b958-4cf0-9961-935ba2807acf None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:56.919685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6ee0-b958-4cf0-9961-935ba2807acf None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:56.919817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc6ee0-b958-4cf0-9961-935ba2807acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:56.937205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-39dc6ee0-b958-4cf0-9961-935ba2807acf None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:56.938430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-39dc6ee0-b958-4cf0-9961-935ba2807acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:57.002033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 570/1132] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:57.271296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925387c6-359f-47fc-9e72-76f7742df92c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:57.367904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925387c6-359f-47fc-9e72-76f7742df92c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:57.400931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d39044-8c14-498e-b6a5-4ef46e106bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:57.401538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d39044-8c14-498e-b6a5-4ef46e106bea None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:57.401843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d39044-8c14-498e-b6a5-4ef46e106bea None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:57.402114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d39044-8c14-498e-b6a5-4ef46e106bea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:57.403212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d39044-8c14-498e-b6a5-4ef46e106bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:57.404615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d39044-8c14-498e-b6a5-4ef46e106bea None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:57.406173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 563/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:17:57.411850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc6ee0-b958-4cf0-9961-935ba2807acf None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:57.507573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc6ee0-b958-4cf0-9961-935ba2807acf None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:57.524358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:57.541709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd045b77-cc91-4762-adcb-f1940777aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:57.542366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045b77-cc91-4762-adcb-f1940777aa23 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:57.542649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045b77-cc91-4762-adcb-f1940777aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:57.542923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045b77-cc91-4762-adcb-f1940777aa23 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:57.543564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd045b77-cc91-4762-adcb-f1940777aa23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:57.545036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd045b77-cc91-4762-adcb-f1940777aa23 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:57.603756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 571/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:17:57 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:17:59.506085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609e53-33cc-4f8d-bef8-dec24c42725c None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:59.506653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609e53-33cc-4f8d-bef8-dec24c42725c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:59.506653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41609e53-33cc-4f8d-bef8-dec24c42725c None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:59.507962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 564/1135] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:59.513103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ec2f-6367-42fa-9cbc-69134fe28f39 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:59.513494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ec2f-6367-42fa-9cbc-69134fe28f39 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:59.513696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ec2f-6367-42fa-9cbc-69134fe28f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:59.531749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b039ec2f-6367-42fa-9cbc-69134fe28f39 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:59.533294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b039ec2f-6367-42fa-9cbc-69134fe28f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:59.598034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 572/1136] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:17:59.866834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41609e53-33cc-4f8d-bef8-dec24c42725c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:59.894118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:59.966843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41609e53-33cc-4f8d-bef8-dec24c42725c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:59.999462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27346-d52b-4329-8fb8-72e1268fb805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:00.000077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27346-d52b-4329-8fb8-72e1268fb805 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:00.000361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27346-d52b-4329-8fb8-72e1268fb805 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:00.000638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27346-d52b-4329-8fb8-72e1268fb805 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:00.001782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27346-d52b-4329-8fb8-72e1268fb805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:00.003213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27346-d52b-4329-8fb8-72e1268fb805 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:00.004776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 565/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:17:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:00.010992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039ec2f-6367-42fa-9cbc-69134fe28f39 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:00.103925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:00.107658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039ec2f-6367-42fa-9cbc-69134fe28f39 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:00.140833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30e356-5ada-4c0c-8bbf-f25d5f0f1418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:00.141374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30e356-5ada-4c0c-8bbf-f25d5f0f1418 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:00.141752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30e356-5ada-4c0c-8bbf-f25d5f0f1418 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:00.142032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30e356-5ada-4c0c-8bbf-f25d5f0f1418 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:00.142674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30e356-5ada-4c0c-8bbf-f25d5f0f1418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:00.144115 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30e356-5ada-4c0c-8bbf-f25d5f0f1418 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:00.236522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 573/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:18:00 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:18:02.176972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e6e2d-ee41-4e37-8323-7d69a2a0f7e6 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:02.177524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e6e2d-ee41-4e37-8323-7d69a2a0f7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:02.177524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e6e2d-ee41-4e37-8323-7d69a2a0f7e6 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:02.178903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 566/1139] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:02.184195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b820b-8a41-40ce-b549-7cb3d540cf73 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:02.184609 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b820b-8a41-40ce-b549-7cb3d540cf73 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:02.184746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b820b-8a41-40ce-b549-7cb3d540cf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:02.202799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-593b820b-8a41-40ce-b549-7cb3d540cf73 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:02.203980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-593b820b-8a41-40ce-b549-7cb3d540cf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:02.268788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 574/1140] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:18:02.533948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e6e2d-ee41-4e37-8323-7d69a2a0f7e6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:02.625884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:02.632865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e6e2d-ee41-4e37-8323-7d69a2a0f7e6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:02.666189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc0ccf-5720-4170-90e3-6044d85698c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:02.666811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc0ccf-5720-4170-90e3-6044d85698c7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:02.667089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc0ccf-5720-4170-90e3-6044d85698c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:02.667367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc0ccf-5720-4170-90e3-6044d85698c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:02.677257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc0ccf-5720-4170-90e3-6044d85698c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-88cc0ccf-5720-4170-90e3-6044d85698c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:18:02.682372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:18:02.683659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:18:02.684602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 567/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:18:02.689395 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b820b-8a41-40ce-b549-7cb3d540cf73 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:02.769512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:02.784424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b820b-8a41-40ce-b549-7cb3d540cf73 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:02.818554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:02.819145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:02.819426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:02.819698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:02.820356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:02.820657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:02.822089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:02.830216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 575/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:18:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:02.836089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc0ccf-5720-4170-90e3-6044d85698c7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:02.937805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc0ccf-5720-4170-90e3-6044d85698c7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:02.969632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cf8d-0ac9-42cb-b358-4e24cfa0b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:02.970257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cf8d-0ac9-42cb-b358-4e24cfa0b74a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:02.970538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cf8d-0ac9-42cb-b358-4e24cfa0b74a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:02.970813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cf8d-0ac9-42cb-b358-4e24cfa0b74a None admin] PATH_INFO: `/v3/users/3025c8f34f4549bdb3f1852d34d095c2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:02.983853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591cf8d-0ac9-42cb-b358-4e24cfa0b74a None admin] RBAC: Authorizing `identity:get_user(user_id=3025c8f34f4549bdb3f1852d34d095c2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:02.985285 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591cf8d-0ac9-42cb-b358-4e24cfa0b74a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:02.986895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 568/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:18:02 2022] GET /identity/v3/users/3025c8f34f4549bdb3f1852d34d095c2 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:02.993088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:03.089885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaeb1b-5eb1-429f-9cc8-add866e1e60a None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:03.122740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b960-0847-450b-ab8f-f5e44abe360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:03.123335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b960-0847-450b-ab8f-f5e44abe360c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:03.123616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b960-0847-450b-ab8f-f5e44abe360c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:03.123888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b960-0847-450b-ab8f-f5e44abe360c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:03.138315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:03.189021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1b960-0847-450b-ab8f-f5e44abe360c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:03.190503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1b960-0847-450b-ab8f-f5e44abe360c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:03.284706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 576/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:18:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:18:03.290735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cf8d-0ac9-42cb-b358-4e24cfa0b74a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:03.306028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:03.387674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cf8d-0ac9-42cb-b358-4e24cfa0b74a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:03.420697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd4653-df43-43f1-a550-306a600d28e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:03.421312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4653-df43-43f1-a550-306a600d28e2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:03.421592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4653-df43-43f1-a550-306a600d28e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:03.421895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd4653-df43-43f1-a550-306a600d28e2 None admin] PATH_INFO: `/v3/projects/5795c386ee2442e389e9f80374d14782` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:03.423003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4653-df43-43f1-a550-306a600d28e2 None admin] RBAC: Authorizing `identity:get_project(project_id=5795c386ee2442e389e9f80374d14782)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:03.424415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd4653-df43-43f1-a550-306a600d28e2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:03.426061 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 569/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:18:03 2022] GET /identity/v3/projects/5795c386ee2442e389e9f80374d14782 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:03.432416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b960-0847-450b-ab8f-f5e44abe360c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:03.478158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:03.532364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b960-0847-450b-ab8f-f5e44abe360c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:03.564927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbe19f-ff9a-4611-8bdd-1e822a5b0f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:03.565519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbe19f-ff9a-4611-8bdd-1e822a5b0f05 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:03.565819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbe19f-ff9a-4611-8bdd-1e822a5b0f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:03.566089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbe19f-ff9a-4611-8bdd-1e822a5b0f05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:03.566804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbe19f-ff9a-4611-8bdd-1e822a5b0f05 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=5795c386ee2442e389e9f80374d14782, user.id=3025c8f34f4549bdb3f1852d34d095c2) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:03.567107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbe19f-ff9a-4611-8bdd-1e822a5b0f05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:03.568545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbe19f-ff9a-4611-8bdd-1e822a5b0f05 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:03.574417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 577/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:18:03 2022] GET /identity/v3/role_assignments?user.id=3025c8f34f4549bdb3f1852d34d095c2&scope.project.id=5795c386ee2442e389e9f80374d14782&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:18:05.454508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a961dd-f954-419e-9b92-95bde282cab7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:05.455047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a961dd-f954-419e-9b92-95bde282cab7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:05.455047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a961dd-f954-419e-9b92-95bde282cab7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:05.456393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 570/1147] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:05.461430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ff9ae-cc6f-43c1-8d9d-86aa4a14633d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:05.461884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ff9ae-cc6f-43c1-8d9d-86aa4a14633d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:05.462025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ff9ae-cc6f-43c1-8d9d-86aa4a14633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:05.480633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d58ff9ae-cc6f-43c1-8d9d-86aa4a14633d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:05.481852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d58ff9ae-cc6f-43c1-8d9d-86aa4a14633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:05.546046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 578/1148] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:05.812291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a961dd-f954-419e-9b92-95bde282cab7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:05.891729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:05.910675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a961dd-f954-419e-9b92-95bde282cab7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:05.944472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae7bf-89f9-4eb9-9d22-2747d23a8d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:05.945087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae7bf-89f9-4eb9-9d22-2747d23a8d80 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:05.945366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae7bf-89f9-4eb9-9d22-2747d23a8d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:05.945666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae7bf-89f9-4eb9-9d22-2747d23a8d80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:05.955365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ae7bf-89f9-4eb9-9d22-2747d23a8d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-ca9ae7bf-89f9-4eb9-9d22-2747d23a8d80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:18:05.959959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:18:05.961094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:18:05.962166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 571/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:18:05.966948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ff9ae-cc6f-43c1-8d9d-86aa4a14633d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:06.007799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:06.064190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ff9ae-cc6f-43c1-8d9d-86aa4a14633d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:06.096562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:06.097158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:06.097440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:06.097741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:06.098402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:06.098704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:06.100070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:06.108287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 579/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:06.114096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae7bf-89f9-4eb9-9d22-2747d23a8d80 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:06.210241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae7bf-89f9-4eb9-9d22-2747d23a8d80 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:06.243432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3cc60-6909-4c2c-96ca-7eef62f0c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:06.244066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3cc60-6909-4c2c-96ca-7eef62f0c058 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:06.244346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3cc60-6909-4c2c-96ca-7eef62f0c058 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:06.244621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3cc60-6909-4c2c-96ca-7eef62f0c058 None admin] PATH_INFO: `/v3/users/3025c8f34f4549bdb3f1852d34d095c2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:06.245753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3cc60-6909-4c2c-96ca-7eef62f0c058 None admin] RBAC: Authorizing `identity:get_user(user_id=3025c8f34f4549bdb3f1852d34d095c2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:06.247183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3cc60-6909-4c2c-96ca-7eef62f0c058 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:06.248719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 572/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:18:06 2022] GET /identity/v3/users/3025c8f34f4549bdb3f1852d34d095c2 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:06.254444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:06.350058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68856dc-540e-4fac-be3b-e9cfc8313bc4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:06.351528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:06.383372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bc8d7-9fdd-46af-81c2-6ed9727f24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:06.383986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc8d7-9fdd-46af-81c2-6ed9727f24ab None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:06.384268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc8d7-9fdd-46af-81c2-6ed9727f24ab None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:06.384566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bc8d7-9fdd-46af-81c2-6ed9727f24ab None admin] PATH_INFO: `/v3/projects/5795c386ee2442e389e9f80374d14782` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:06.385708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bc8d7-9fdd-46af-81c2-6ed9727f24ab None admin] RBAC: Authorizing `identity:get_project(project_id=5795c386ee2442e389e9f80374d14782)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:06.387139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bc8d7-9fdd-46af-81c2-6ed9727f24ab None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:06.388738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 580/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:18:06 2022] GET /identity/v3/projects/5795c386ee2442e389e9f80374d14782 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:06.394501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3cc60-6909-4c2c-96ca-7eef62f0c058 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:06.405549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:06.493856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3cc60-6909-4c2c-96ca-7eef62f0c058 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:06.526671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da3762-bfd1-4db7-a1ec-5dfdff33e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:06.527307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3762-bfd1-4db7-a1ec-5dfdff33e6ad None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:06.527587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3762-bfd1-4db7-a1ec-5dfdff33e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:06.527860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da3762-bfd1-4db7-a1ec-5dfdff33e6ad None admin] PATH_INFO: `/v3/projects/5795c386ee2442e389e9f80374d14782/users/3025c8f34f4549bdb3f1852d34d095c2/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:06.529755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da3762-bfd1-4db7-a1ec-5dfdff33e6ad None admin] RBAC: Authorizing `identity:create_grant(project_id=5795c386ee2442e389e9f80374d14782, user_id=3025c8f34f4549bdb3f1852d34d095c2, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:06.531170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da3762-bfd1-4db7-a1ec-5dfdff33e6ad None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:06.613666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 573/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:18:06 2022] PUT /identity/v3/projects/5795c386ee2442e389e9f80374d14782/users/3025c8f34f4549bdb3f1852d34d095c2/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:18:08.472000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810fc4-f329-4976-8a2b-3bd2c58cc7a6 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:08.472575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810fc4-f329-4976-8a2b-3bd2c58cc7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:08.472575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810fc4-f329-4976-8a2b-3bd2c58cc7a6 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:08.473961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 581/1154] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:08.479891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e88b6-e9d7-41cf-b366-22ee8a1543b3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:08.480283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e88b6-e9d7-41cf-b366-22ee8a1543b3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:08.480444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e88b6-e9d7-41cf-b366-22ee8a1543b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:08.498170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cc4e88b6-e9d7-41cf-b366-22ee8a1543b3 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:08.499347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cc4e88b6-e9d7-41cf-b366-22ee8a1543b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:08.558068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:08.563271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 574/1155] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:08.829172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810fc4-f329-4976-8a2b-3bd2c58cc7a6 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:08.930672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810fc4-f329-4976-8a2b-3bd2c58cc7a6 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:08.964474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427dc44-031f-4a64-87bc-9d7f534378ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:08.965094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427dc44-031f-4a64-87bc-9d7f534378ae None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:08.965374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427dc44-031f-4a64-87bc-9d7f534378ae None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:08.965668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427dc44-031f-4a64-87bc-9d7f534378ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:08.975560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427dc44-031f-4a64-87bc-9d7f534378ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-c427dc44-031f-4a64-87bc-9d7f534378ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:18:08.980717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:18:08.981881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:18:08.983179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 582/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:18:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:18:08.987979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e88b6-e9d7-41cf-b366-22ee8a1543b3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:09.087864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e88b6-e9d7-41cf-b366-22ee8a1543b3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:09.121751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:09.122349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:09.122627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:09.122897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:09.123552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:09.123855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:09.125217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:09.133038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 575/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:18:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:09.138839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427dc44-031f-4a64-87bc-9d7f534378ae None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:09.170523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:09.239391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427dc44-031f-4a64-87bc-9d7f534378ae None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:09.272902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c7ad5-e167-47c1-b740-4cee4c386c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:09.273525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7ad5-e167-47c1-b740-4cee4c386c4e None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:09.273833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7ad5-e167-47c1-b740-4cee4c386c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:09.274108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7ad5-e167-47c1-b740-4cee4c386c4e None admin] PATH_INFO: `/v3/users/3025c8f34f4549bdb3f1852d34d095c2` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:09.275761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c7ad5-e167-47c1-b740-4cee4c386c4e None admin] RBAC: Authorizing `identity:get_user(user_id=3025c8f34f4549bdb3f1852d34d095c2)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:09.277196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c7ad5-e167-47c1-b740-4cee4c386c4e None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:09.278815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 583/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:18:09 2022] GET /identity/v3/users/3025c8f34f4549bdb3f1852d34d095c2 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:09.284719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:09.344352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:09.387144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa0a3e-63fc-4574-9885-7a946da2d44f None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:09.421224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d727454-3499-4287-92ef-a5bad03ac81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:09.421857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727454-3499-4287-92ef-a5bad03ac81b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:09.422296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727454-3499-4287-92ef-a5bad03ac81b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:09.422738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d727454-3499-4287-92ef-a5bad03ac81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:09.488176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d727454-3499-4287-92ef-a5bad03ac81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:09.489652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d727454-3499-4287-92ef-a5bad03ac81b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:09.546008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:09.586860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 576/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:18:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:18:09.593332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c7ad5-e167-47c1-b740-4cee4c386c4e None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:09.688212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:09.691915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c7ad5-e167-47c1-b740-4cee4c386c4e None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:09.725495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365f72a-1229-4cdb-8403-d2b4cf00a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:09.726139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f72a-1229-4cdb-8403-d2b4cf00a190 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:09.726423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f72a-1229-4cdb-8403-d2b4cf00a190 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:09.726697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365f72a-1229-4cdb-8403-d2b4cf00a190 None admin] PATH_INFO: `/v3/projects/5795c386ee2442e389e9f80374d14782` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:09.728006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365f72a-1229-4cdb-8403-d2b4cf00a190 None admin] RBAC: Authorizing `identity:get_project(project_id=5795c386ee2442e389e9f80374d14782)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:09.730022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365f72a-1229-4cdb-8403-d2b4cf00a190 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:09.731672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 584/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:18:09 2022] GET /identity/v3/projects/5795c386ee2442e389e9f80374d14782 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:09.737910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d727454-3499-4287-92ef-a5bad03ac81b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:09.834047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d727454-3499-4287-92ef-a5bad03ac81b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:09.867771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ced2e1-0a10-437f-a166-557a07fd0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:09.868360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ced2e1-0a10-437f-a166-557a07fd0b56 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:09.868639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ced2e1-0a10-437f-a166-557a07fd0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:09.868912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ced2e1-0a10-437f-a166-557a07fd0b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:09.869650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ced2e1-0a10-437f-a166-557a07fd0b56 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=5795c386ee2442e389e9f80374d14782, user.id=3025c8f34f4549bdb3f1852d34d095c2) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:09.869961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ced2e1-0a10-437f-a166-557a07fd0b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:09.871408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ced2e1-0a10-437f-a166-557a07fd0b56 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:09.876970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 577/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:18:09 2022] GET /identity/v3/role_assignments?user.id=3025c8f34f4549bdb3f1852d34d095c2&scope.project.id=5795c386ee2442e389e9f80374d14782&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:11.803917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b43e-0a80-4a9e-9252-b003a5ed3e9d None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:11.804459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b43e-0a80-4a9e-9252-b003a5ed3e9d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:11.804459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218b43e-0a80-4a9e-9252-b003a5ed3e9d None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:11.805808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 585/1162] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:11.811077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2fb5-bf9d-4847-aae8-f1f622498e3a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:11.811506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2fb5-bf9d-4847-aae8-f1f622498e3a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:11.811616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2fb5-bf9d-4847-aae8-f1f622498e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:11.829415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7b1d2fb5-bf9d-4847-aae8-f1f622498e3a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:11.830611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7b1d2fb5-bf9d-4847-aae8-f1f622498e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:11.847645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:11.895113 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 578/1163] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:12.162033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218b43e-0a80-4a9e-9252-b003a5ed3e9d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:12.258742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218b43e-0a80-4a9e-9252-b003a5ed3e9d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:12.290831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb497ce-1b28-4042-a2cf-a085c3126dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:12.291419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb497ce-1b28-4042-a2cf-a085c3126dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:12.291698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb497ce-1b28-4042-a2cf-a085c3126dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:12.291967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb497ce-1b28-4042-a2cf-a085c3126dc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:12.323889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:12.356267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb497ce-1b28-4042-a2cf-a085c3126dc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:12.357736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb497ce-1b28-4042-a2cf-a085c3126dc9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:12.450718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 586/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:18:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:18:12.456608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d2fb5-bf9d-4847-aae8-f1f622498e3a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:12.552928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d2fb5-bf9d-4847-aae8-f1f622498e3a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:12.585374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bcaab-21f9-4ab7-b388-9f226af99ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:12.585957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bcaab-21f9-4ab7-b388-9f226af99ceb None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:12.586236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bcaab-21f9-4ab7-b388-9f226af99ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:12.586506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bcaab-21f9-4ab7-b388-9f226af99ceb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:12.593517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bcaab-21f9-4ab7-b388-9f226af99ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:12.594971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bcaab-21f9-4ab7-b388-9f226af99ceb None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-359bcaab-21f9-4ab7-b388-9f226af99ceb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:18:12.605837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:18:12.607089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:18:12.608183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 579/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:18:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:18:12.612699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb497ce-1b28-4042-a2cf-a085c3126dc9 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:12.675227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:12.708354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb497ce-1b28-4042-a2cf-a085c3126dc9 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:12.740355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea3476-2815-477f-8d89-ec4cd849dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:12.741197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea3476-2815-477f-8d89-ec4cd849dc04 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:12.741477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea3476-2815-477f-8d89-ec4cd849dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:12.741772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea3476-2815-477f-8d89-ec4cd849dc04 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:12.742404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea3476-2815-477f-8d89-ec4cd849dc04 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:12.742699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea3476-2815-477f-8d89-ec4cd849dc04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:12.744046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea3476-2815-477f-8d89-ec4cd849dc04 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:12.750809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 587/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Tue Aug 23 16:18:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:14.630323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca148-e4dd-4ac3-b957-5961c6836a31 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:14.630861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca148-e4dd-4ac3-b957-5961c6836a31 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:14.630861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aca148-e4dd-4ac3-b957-5961c6836a31 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:14.632182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 580/1167] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:14.637970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ea1a-7773-4507-ad95-d010d4e75d1b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:14.638399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ea1a-7773-4507-ad95-d010d4e75d1b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:14.638531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ea1a-7773-4507-ad95-d010d4e75d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:14.656040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-45e5ea1a-7773-4507-ad95-d010d4e75d1b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:14.657216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-45e5ea1a-7773-4507-ad95-d010d4e75d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:14.721299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 588/1168] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:14.998156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aca148-e4dd-4ac3-b957-5961c6836a31 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:15.013870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:15.097937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aca148-e4dd-4ac3-b957-5961c6836a31 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:15.133018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb4b8a-97fb-4f11-8a86-ffbbeb395a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:15.133644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4b8a-97fb-4f11-8a86-ffbbeb395a90 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:15.133931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4b8a-97fb-4f11-8a86-ffbbeb395a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:15.134205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb4b8a-97fb-4f11-8a86-ffbbeb395a90 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:15.134890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb4b8a-97fb-4f11-8a86-ffbbeb395a90 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:15.136262 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb4b8a-97fb-4f11-8a86-ffbbeb395a90 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:15.192063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 581/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Tue Aug 23 16:18:14 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:18:17.108929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1425-c7ca-422b-ba7f-0a811bb9f108 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:17.109420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1425-c7ca-422b-ba7f-0a811bb9f108 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:17.109515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1425-c7ca-422b-ba7f-0a811bb9f108 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:17.110870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 589/1170] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:17.116091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6cee-11d3-4d31-b5a9-1f8f3024ad13 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:17.116762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6cee-11d3-4d31-b5a9-1f8f3024ad13 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:17.116875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6cee-11d3-4d31-b5a9-1f8f3024ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:17.134256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-535c6cee-11d3-4d31-b5a9-1f8f3024ad13 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:17.135954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-535c6cee-11d3-4d31-b5a9-1f8f3024ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:17.199634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 582/1171] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:17.479938 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c1425-c7ca-422b-ba7f-0a811bb9f108 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:17.538590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:17.579026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c1425-c7ca-422b-ba7f-0a811bb9f108 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:17.614095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382278c-ac25-436b-b19e-592a771347cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:17.614853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382278c-ac25-436b-b19e-592a771347cd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:17.615192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382278c-ac25-436b-b19e-592a771347cd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:17.615512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382278c-ac25-436b-b19e-592a771347cd None admin] PATH_INFO: `/v3/domains/4a9f944a4e0f4786b7a4a8c7fbfbb92f` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:17.628578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382278c-ac25-436b-b19e-592a771347cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=4a9f944a4e0f4786b7a4a8c7fbfbb92f)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:17.630046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382278c-ac25-436b-b19e-592a771347cd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:17.631592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 590/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Tue Aug 23 16:18:17 2022] GET /identity/v3/domains/4a9f944a4e0f4786b7a4a8c7fbfbb92f => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:17.637945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6cee-11d3-4d31-b5a9-1f8f3024ad13 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:17.640985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:17.733852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6cee-11d3-4d31-b5a9-1f8f3024ad13 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:17.767906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164d0c7-023b-46cb-904c-10fa3d7d113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:17.768489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d0c7-023b-46cb-904c-10fa3d7d113d None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:17.768763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d0c7-023b-46cb-904c-10fa3d7d113d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:17.769027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164d0c7-023b-46cb-904c-10fa3d7d113d None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:17.769682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164d0c7-023b-46cb-904c-10fa3d7d113d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:17.771115 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164d0c7-023b-46cb-904c-10fa3d7d113d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:17.855738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 583/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:18:17 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:18:19.795015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfa43-3358-4072-bd38-094b75b7d8c1 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:19.795549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfa43-3358-4072-bd38-094b75b7d8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:19.795549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dfa43-3358-4072-bd38-094b75b7d8c1 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:19.796889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 591/1174] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:19.802283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eb5fa-b5ea-4c79-a431-9197c25b9c0d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:19.802701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eb5fa-b5ea-4c79-a431-9197c25b9c0d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:19.802814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eb5fa-b5ea-4c79-a431-9197c25b9c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:19.820585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f89eb5fa-b5ea-4c79-a431-9197c25b9c0d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:19.821801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f89eb5fa-b5ea-4c79-a431-9197c25b9c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:19.870908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:19.886507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 584/1175] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:20.155955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfa43-3358-4072-bd38-094b75b7d8c1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:20.252261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dfa43-3358-4072-bd38-094b75b7d8c1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:20.271388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:20.284933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e804dc-9798-418a-8b3b-61720ca25d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:20.285532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e804dc-9798-418a-8b3b-61720ca25d04 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:20.285836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e804dc-9798-418a-8b3b-61720ca25d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:20.286106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e804dc-9798-418a-8b3b-61720ca25d04 None admin] PATH_INFO: `/v3/domains/4a9f944a4e0f4786b7a4a8c7fbfbb92f` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:20.287207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e804dc-9798-418a-8b3b-61720ca25d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4a9f944a4e0f4786b7a4a8c7fbfbb92f)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:20.288694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e804dc-9798-418a-8b3b-61720ca25d04 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:20.290263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 592/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Tue Aug 23 16:18:20 2022] GET /identity/v3/domains/4a9f944a4e0f4786b7a4a8c7fbfbb92f => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:20.296064 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89eb5fa-b5ea-4c79-a431-9197c25b9c0d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:20.390982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89eb5fa-b5ea-4c79-a431-9197c25b9c0d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:20.423790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ad317-276d-4a19-9481-97da1c4bae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:20.424381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ad317-276d-4a19-9481-97da1c4bae37 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:20.424658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ad317-276d-4a19-9481-97da1c4bae37 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:20.424927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ad317-276d-4a19-9481-97da1c4bae37 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:20.425573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ad317-276d-4a19-9481-97da1c4bae37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:20.427057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ad317-276d-4a19-9481-97da1c4bae37 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:20.495305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 585/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:18:20 2022] POST /identity/v3/users => generated 311 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:18:22.416354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053867-f284-423c-9c65-49bfdd7268b7 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:22.416940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053867-f284-423c-9c65-49bfdd7268b7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:22.417091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053867-f284-423c-9c65-49bfdd7268b7 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:22.419028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 593/1178] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:22.424573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b26ce-73c8-4fd4-bde3-6edb322b1174 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:22.425045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b26ce-73c8-4fd4-bde3-6edb322b1174 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:22.425147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b26ce-73c8-4fd4-bde3-6edb322b1174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:22.442629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6d0b26ce-73c8-4fd4-bde3-6edb322b1174 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:22.443807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6d0b26ce-73c8-4fd4-bde3-6edb322b1174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:22.478300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:22.514307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 586/1179] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:22.778380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52053867-f284-423c-9c65-49bfdd7268b7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:22.876782 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52053867-f284-423c-9c65-49bfdd7268b7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:22.909961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ec5e4-acc3-41ab-a413-864f301b81d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:22.910613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ec5e4-acc3-41ab-a413-864f301b81d5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:22.910891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ec5e4-acc3-41ab-a413-864f301b81d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:22.911161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ec5e4-acc3-41ab-a413-864f301b81d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:22.920938 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ec5e4-acc3-41ab-a413-864f301b81d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-eb5ec5e4-acc3-41ab-a413-864f301b81d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:18:22.925836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:18:22.927070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:18:22.928236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 594/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:18:22.933426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b26ce-73c8-4fd4-bde3-6edb322b1174 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:23.078117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b26ce-73c8-4fd4-bde3-6edb322b1174 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:23.111070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:23.111668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:23.111950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:23.112223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:23.112884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:23.113185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:23.114576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:23.123191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 587/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:23.129015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ec5e4-acc3-41ab-a413-864f301b81d5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:23.176223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:23.224855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ec5e4-acc3-41ab-a413-864f301b81d5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:23.257374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fd04f-4227-488d-bb8e-2a756304f148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:23.258009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fd04f-4227-488d-bb8e-2a756304f148 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:23.258288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fd04f-4227-488d-bb8e-2a756304f148 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:23.258558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90fd04f-4227-488d-bb8e-2a756304f148 None admin] PATH_INFO: `/v3/users/afcf4bce4afe4869ad2e0f111f941801` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:23.270827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fd04f-4227-488d-bb8e-2a756304f148 None admin] RBAC: Authorizing `identity:get_user(user_id=afcf4bce4afe4869ad2e0f111f941801)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:23.272258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90fd04f-4227-488d-bb8e-2a756304f148 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:23.273835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 595/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:18:23 2022] GET /identity/v3/users/afcf4bce4afe4869ad2e0f111f941801 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:23.279684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:23.314066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:23.377519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbfc34-e397-487a-873b-34c3e69f8509 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:23.409813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bee74-a400-4d34-9e00-9bd8fa689788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:23.410402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bee74-a400-4d34-9e00-9bd8fa689788 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:23.410678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bee74-a400-4d34-9e00-9bd8fa689788 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:23.410946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bee74-a400-4d34-9e00-9bd8fa689788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:23.474990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bee74-a400-4d34-9e00-9bd8fa689788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:23.476414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909bee74-a400-4d34-9e00-9bd8fa689788 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:23.507687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:23.570467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 588/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:18:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:18:23.576227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fd04f-4227-488d-bb8e-2a756304f148 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:23.672693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90fd04f-4227-488d-bb8e-2a756304f148 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:23.679740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:23.704931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1a0bc-6f44-40ab-b9ae-80a2e58b6a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:23.705753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a0bc-6f44-40ab-b9ae-80a2e58b6a7b None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:23.706195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a0bc-6f44-40ab-b9ae-80a2e58b6a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:23.706509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1a0bc-6f44-40ab-b9ae-80a2e58b6a7b None admin] PATH_INFO: `/v3/projects/835c0f853e294f7bbe56c46ee0d6691b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:23.707914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1a0bc-6f44-40ab-b9ae-80a2e58b6a7b None admin] RBAC: Authorizing `identity:get_project(project_id=835c0f853e294f7bbe56c46ee0d6691b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:23.709328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1a0bc-6f44-40ab-b9ae-80a2e58b6a7b None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:23.710945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 596/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:18:23 2022] GET /identity/v3/projects/835c0f853e294f7bbe56c46ee0d6691b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:23.717596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bee74-a400-4d34-9e00-9bd8fa689788 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:23.823751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bee74-a400-4d34-9e00-9bd8fa689788 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:23.857903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18e18a-36bd-4073-9265-fb3f110535f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:23.858512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e18a-36bd-4073-9265-fb3f110535f2 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:23.858799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e18a-36bd-4073-9265-fb3f110535f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:23.859075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18e18a-36bd-4073-9265-fb3f110535f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:23.859801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18e18a-36bd-4073-9265-fb3f110535f2 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=835c0f853e294f7bbe56c46ee0d6691b, user.id=afcf4bce4afe4869ad2e0f111f941801) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:23.860112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18e18a-36bd-4073-9265-fb3f110535f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:23.861584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18e18a-36bd-4073-9265-fb3f110535f2 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:23.863379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:23.867708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 589/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:18:23 2022] GET /identity/v3/role_assignments?user.id=afcf4bce4afe4869ad2e0f111f941801&scope.project.id=835c0f853e294f7bbe56c46ee0d6691b&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:25.763372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed392ce3-ce68-426d-8722-7bb03d1a05ee None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:25.763956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed392ce3-ce68-426d-8722-7bb03d1a05ee None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:25.763956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed392ce3-ce68-426d-8722-7bb03d1a05ee None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:25.765255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 597/1186] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:25.770563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d7172-e696-4bd5-89f7-13c3cab4be52 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:25.771043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d7172-e696-4bd5-89f7-13c3cab4be52 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:25.771160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d7172-e696-4bd5-89f7-13c3cab4be52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:25.792496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0a8d7172-e696-4bd5-89f7-13c3cab4be52 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:25.793723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0a8d7172-e696-4bd5-89f7-13c3cab4be52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:25.860139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 590/1187] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:26.129274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed392ce3-ce68-426d-8722-7bb03d1a05ee None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:26.229408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed392ce3-ce68-426d-8722-7bb03d1a05ee None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:26.262647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e38e-ed18-408e-9d89-94400c1c0ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:26.263261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e38e-ed18-408e-9d89-94400c1c0ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:26.263543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e38e-ed18-408e-9d89-94400c1c0ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:26.263818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e38e-ed18-408e-9d89-94400c1c0ac7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:26.273512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025e38e-ed18-408e-9d89-94400c1c0ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-d025e38e-ed18-408e-9d89-94400c1c0ac7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:18:26.278820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:18:26.279945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:18:26.280828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 598/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:18:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:18:26.285926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d7172-e696-4bd5-89f7-13c3cab4be52 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:26.380465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d7172-e696-4bd5-89f7-13c3cab4be52 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:26.406454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:26.413750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:26.414341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:26.414617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:26.414884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:26.415538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:26.415835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:26.417193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:26.425286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 591/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:18:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:26.431239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e38e-ed18-408e-9d89-94400c1c0ac7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:26.469088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:26.534644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e38e-ed18-408e-9d89-94400c1c0ac7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:26.567037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621b020-d23b-491f-953a-9be6143d3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:26.567651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621b020-d23b-491f-953a-9be6143d3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:26.567927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621b020-d23b-491f-953a-9be6143d3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:26.568213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621b020-d23b-491f-953a-9be6143d3ca0 None admin] PATH_INFO: `/v3/users/afcf4bce4afe4869ad2e0f111f941801` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:26.569318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621b020-d23b-491f-953a-9be6143d3ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=afcf4bce4afe4869ad2e0f111f941801)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:26.570771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621b020-d23b-491f-953a-9be6143d3ca0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:26.572949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 599/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:18:26 2022] GET /identity/v3/users/afcf4bce4afe4869ad2e0f111f941801 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:26.578877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:26.674816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e14c35-213c-4ca4-80da-dcce999e9af0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:26.707600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0e5be-398f-4d45-9d84-87a5f26b43d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:26.708205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0e5be-398f-4d45-9d84-87a5f26b43d9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:26.708482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0e5be-398f-4d45-9d84-87a5f26b43d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:26.708753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0e5be-398f-4d45-9d84-87a5f26b43d9 None admin] PATH_INFO: `/v3/projects/835c0f853e294f7bbe56c46ee0d6691b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:26.709864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0e5be-398f-4d45-9d84-87a5f26b43d9 None admin] RBAC: Authorizing `identity:get_project(project_id=835c0f853e294f7bbe56c46ee0d6691b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:26.711277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0e5be-398f-4d45-9d84-87a5f26b43d9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:26.712881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 592/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:18:26 2022] GET /identity/v3/projects/835c0f853e294f7bbe56c46ee0d6691b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:26.718774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621b020-d23b-491f-953a-9be6143d3ca0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:26.817572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621b020-d23b-491f-953a-9be6143d3ca0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:26.819458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:26.852423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2ba4d-1d81-483b-9735-981542332ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:26.853072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ba4d-1d81-483b-9735-981542332ca5 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:26.853888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ba4d-1d81-483b-9735-981542332ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:26.854183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ba4d-1d81-483b-9735-981542332ca5 None admin] PATH_INFO: `/v3/projects/835c0f853e294f7bbe56c46ee0d6691b/users/afcf4bce4afe4869ad2e0f111f941801/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:26.856079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2ba4d-1d81-483b-9735-981542332ca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=835c0f853e294f7bbe56c46ee0d6691b, user_id=afcf4bce4afe4869ad2e0f111f941801, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:26.857507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2ba4d-1d81-483b-9735-981542332ca5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:26.928106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 600/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:18:26 2022] PUT /identity/v3/projects/835c0f853e294f7bbe56c46ee0d6691b/users/afcf4bce4afe4869ad2e0f111f941801/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:18:28.797630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d649447-c837-4c4c-8c19-155bf6ff6486 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:28.798193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d649447-c837-4c4c-8c19-155bf6ff6486 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:28.798193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d649447-c837-4c4c-8c19-155bf6ff6486 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:28.799517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 593/1193] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:28.804753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecd6af-3325-4d86-ab04-c10f413591d3 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:28.805202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecd6af-3325-4d86-ab04-c10f413591d3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:28.805299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecd6af-3325-4d86-ab04-c10f413591d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:28.822731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-91ecd6af-3325-4d86-ab04-c10f413591d3 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:28.823924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-91ecd6af-3325-4d86-ab04-c10f413591d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:28.887968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 601/1194] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:18:29.173002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d649447-c837-4c4c-8c19-155bf6ff6486 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:29.230608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:29.271955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d649447-c837-4c4c-8c19-155bf6ff6486 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:29.305034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa431-0c8a-471e-ba8f-34e8a9a309ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:29.305740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa431-0c8a-471e-ba8f-34e8a9a309ca None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:29.306072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa431-0c8a-471e-ba8f-34e8a9a309ca None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:29.306396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa431-0c8a-471e-ba8f-34e8a9a309ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:29.317190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fa431-0c8a-471e-ba8f-34e8a9a309ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-946fa431-0c8a-471e-ba8f-34e8a9a309ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:18:29.322700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:18:29.323868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:18:29.324921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 594/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:18:29.329676 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecd6af-3325-4d86-ab04-c10f413591d3 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:29.416253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:29.424490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecd6af-3325-4d86-ab04-c10f413591d3 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:29.457818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:29.463908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:29.463908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:29.463908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:29.463908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:29.463908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:29.463908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:29.468856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 602/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:29.474634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa431-0c8a-471e-ba8f-34e8a9a309ca None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:29.571088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa431-0c8a-471e-ba8f-34e8a9a309ca None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:29.587635 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:29.604755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b6f86-9e9c-4159-9d31-bdec4126306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:29.605378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b6f86-9e9c-4159-9d31-bdec4126306d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:29.605685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b6f86-9e9c-4159-9d31-bdec4126306d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:29.605969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b6f86-9e9c-4159-9d31-bdec4126306d None admin] PATH_INFO: `/v3/users/afcf4bce4afe4869ad2e0f111f941801` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:29.607076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b6f86-9e9c-4159-9d31-bdec4126306d None admin] RBAC: Authorizing `identity:get_user(user_id=afcf4bce4afe4869ad2e0f111f941801)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:29.608622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b6f86-9e9c-4159-9d31-bdec4126306d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:29.610221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 595/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Tue Aug 23 16:18:29 2022] GET /identity/v3/users/afcf4bce4afe4869ad2e0f111f941801 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:18:29.616213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:29.714861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5c6c5-683b-4b31-aad3-dc554d84c688 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:29.754074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67eae4-4dfb-434e-af43-a944a97890c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:29.754659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67eae4-4dfb-434e-af43-a944a97890c9 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:29.754934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67eae4-4dfb-434e-af43-a944a97890c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:29.755202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67eae4-4dfb-434e-af43-a944a97890c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:29.778094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:29.825962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67eae4-4dfb-434e-af43-a944a97890c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:29.827342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67eae4-4dfb-434e-af43-a944a97890c9 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:29.920069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 603/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:18:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:18:29.926081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b6f86-9e9c-4159-9d31-bdec4126306d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:30.022256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b6f86-9e9c-4159-9d31-bdec4126306d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:30.054516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006047ba-1b37-4c1c-90bf-45fa38d11e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:30.055139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006047ba-1b37-4c1c-90bf-45fa38d11e82 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:30.055420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006047ba-1b37-4c1c-90bf-45fa38d11e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:30.055693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006047ba-1b37-4c1c-90bf-45fa38d11e82 None admin] PATH_INFO: `/v3/projects/835c0f853e294f7bbe56c46ee0d6691b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:30.056806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006047ba-1b37-4c1c-90bf-45fa38d11e82 None admin] RBAC: Authorizing `identity:get_project(project_id=835c0f853e294f7bbe56c46ee0d6691b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:30.058297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006047ba-1b37-4c1c-90bf-45fa38d11e82 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:30.059939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 596/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Tue Aug 23 16:18:29 2022] GET /identity/v3/projects/835c0f853e294f7bbe56c46ee0d6691b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:30.065985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67eae4-4dfb-434e-af43-a944a97890c9 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:30.118962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:30.161259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67eae4-4dfb-434e-af43-a944a97890c9 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:30.199299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153901a-38ca-4a9d-9c49-c96bba95df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:30.199887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153901a-38ca-4a9d-9c49-c96bba95df2c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:30.200166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153901a-38ca-4a9d-9c49-c96bba95df2c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:30.200435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153901a-38ca-4a9d-9c49-c96bba95df2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:30.201152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153901a-38ca-4a9d-9c49-c96bba95df2c None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=835c0f853e294f7bbe56c46ee0d6691b, user.id=afcf4bce4afe4869ad2e0f111f941801) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:18:30.201456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153901a-38ca-4a9d-9c49-c96bba95df2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:30.203360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153901a-38ca-4a9d-9c49-c96bba95df2c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:30.209125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 604/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:18:30 2022] GET /identity/v3/role_assignments?user.id=afcf4bce4afe4869ad2e0f111f941801&scope.project.id=835c0f853e294f7bbe56c46ee0d6691b&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:18:40.050457 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=73 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:40.206596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=41 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:40.218843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5bd3-275d-4165-a5e9-ad1309549bb4 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:40.220055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5bd3-275d-4165-a5e9-ad1309549bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:40.220055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5bd3-275d-4165-a5e9-ad1309549bb4 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:40.221299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 597/1201] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:40.226657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb5ba-1b19-409f-8114-a4065d99c41f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:40.228983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb5ba-1b19-409f-8114-a4065d99c41f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:40.228983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eb5ba-1b19-409f-8114-a4065d99c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:40.245189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ed0eb5ba-1b19-409f-8114-a4065d99c41f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:40.246662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ed0eb5ba-1b19-409f-8114-a4065d99c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:40.312070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 605/1202] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:19:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:19:40.582827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5bd3-275d-4165-a5e9-ad1309549bb4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:40.683130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5bd3-275d-4165-a5e9-ad1309549bb4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:40.716590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:40.717209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:40.717489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:40.717793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:40.728833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:40.730379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:40.745851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:40.747124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:40.748439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:40.748439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:40.748439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:40.748439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 598/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:40.753212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb5ba-1b19-409f-8114-a4065d99c41f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:40.851064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eb5ba-1b19-409f-8114-a4065d99c41f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:40.879568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:40.885288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0795ed8-f543-4a49-b516-69725e6d72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:40.885925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795ed8-f543-4a49-b516-69725e6d72be None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:40.886207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795ed8-f543-4a49-b516-69725e6d72be None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:40.886481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795ed8-f543-4a49-b516-69725e6d72be None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:40.887127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795ed8-f543-4a49-b516-69725e6d72be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:40.887434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795ed8-f543-4a49-b516-69725e6d72be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:40.888813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795ed8-f543-4a49-b516-69725e6d72be None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:40.900301 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 606/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:40.906251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:40.959616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:41.005744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49572cb2-96d7-495f-abca-02c818671750 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:41.039248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10abb7-b63e-44f9-8fa4-e2d4ca638607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:41.039840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10abb7-b63e-44f9-8fa4-e2d4ca638607 None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:41.040116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10abb7-b63e-44f9-8fa4-e2d4ca638607 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:41.040384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10abb7-b63e-44f9-8fa4-e2d4ca638607 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:41.041024 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10abb7-b63e-44f9-8fa4-e2d4ca638607 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:41.042492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10abb7-b63e-44f9-8fa4-e2d4ca638607 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:41.183028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 599/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Tue Aug 23 16:19:40 2022] POST /identity/v3/users => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:19:43.112331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f61b5-2837-455e-ba0f-f83710d170aa None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:43.112854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f61b5-2837-455e-ba0f-f83710d170aa None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:43.112962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f61b5-2837-455e-ba0f-f83710d170aa None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:43.114304 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 607/1206] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:19:43.119602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d987-0478-459a-b275-9ab286543bfe None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:43.119989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d987-0478-459a-b275-9ab286543bfe None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:43.120153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d987-0478-459a-b275-9ab286543bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:43.139502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ec21d987-0478-459a-b275-9ab286543bfe None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:43.140666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ec21d987-0478-459a-b275-9ab286543bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:43.207149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 600/1207] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:19:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:19:43.481019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f61b5-2837-455e-ba0f-f83710d170aa None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:43.581766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f61b5-2837-455e-ba0f-f83710d170aa None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:43.615007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dff273-0933-4ada-b80d-d8f4092a52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:43.615627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff273-0933-4ada-b80d-d8f4092a52c4 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:43.615926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff273-0933-4ada-b80d-d8f4092a52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:43.616186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dff273-0933-4ada-b80d-d8f4092a52c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:43.630337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dff273-0933-4ada-b80d-d8f4092a52c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-42dff273-0933-4ada-b80d-d8f4092a52c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:19:43.632131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:43.633340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:43.634414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 608/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:43.639432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d987-0478-459a-b275-9ab286543bfe None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:43.680557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:43.740897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d987-0478-459a-b275-9ab286543bfe None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:43.773724 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:43.774329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:43.774608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:43.774879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:43.775541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:43.775842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:43.777215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:43.785347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 601/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:43.791298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dff273-0933-4ada-b80d-d8f4092a52c4 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:43.841489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:43.890245 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dff273-0933-4ada-b80d-d8f4092a52c4 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:43.923645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:43.924282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:43.924572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:43.924851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:43.935166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:43.936655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:43.950979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:43.952146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:43.953418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:43.953418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:43.953418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:43.953418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 609/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:43.959086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:44.067217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:44.070265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253f370-3cc5-4d5b-b1fa-a7ea60f7e3e9 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:44.105393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:44.106025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:44.106309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:44.106584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:44.107311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:44.107627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:44.108991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:44.120598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 602/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:44.126612 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:44.227092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f04ad9-e2aa-4f0c-86b1-7c5a7cbfa5c3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:44.228675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:44.260771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:44.261397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:44.261792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:44.262076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:44.269508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:44.271097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:19:44.282306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:44.283498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:44.284633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 610/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:44.292846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:44.395897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00e3e-a1d9-4d75-9041-a83ce1ddcd81 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:44.428758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:44.429358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:44.429662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:44.429939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:44.430664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:44.430966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:44.432389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:44.449727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 603/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Aug 23 16:19:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:44.456221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:44.554339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725621d0-8297-4693-b3b3-678ba15c722f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:44.587553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62d0fd-47c1-40f7-93bc-48df65dc5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:44.588150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d0fd-47c1-40f7-93bc-48df65dc5ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:44.588430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d0fd-47c1-40f7-93bc-48df65dc5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:44.588702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62d0fd-47c1-40f7-93bc-48df65dc5ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:44.617956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:44.655216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62d0fd-47c1-40f7-93bc-48df65dc5ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:44.656974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62d0fd-47c1-40f7-93bc-48df65dc5ef7 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:44.754354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 611/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:19:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:19:44.760188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:44.779238 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:44.858423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e58cc-1b1e-4f6c-b17d-1e6417199b55 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:44.892790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:44.893411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:44.893719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:44.893996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:44.903821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:44.905309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:44.920158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:44.921253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:44.922898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:44.922898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:44.922898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:44.922898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 604/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:44.927575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62d0fd-47c1-40f7-93bc-48df65dc5ef7 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:44.987986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:45.029138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62d0fd-47c1-40f7-93bc-48df65dc5ef7 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:45.064447 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:45.065051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:45.065489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:45.065801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:45.066441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:45.066741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:45.068187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:45.080510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 612/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:19:45.086483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:45.155046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:45.185525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568c59c-e2a5-45c7-91b1-5af6abc746e7 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:45.218322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:45.218935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:45.219210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:45.219977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:45.226387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:45.227835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:19:45.239379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:45.243007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:45.244145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 605/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:45.246697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:45.343598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1490c73-4252-4fe3-be4e-807490c02f10 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:45.366232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:45.377595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23b7d8-dfbf-4eee-8ac8-a4c323d79e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:45.378220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23b7d8-dfbf-4eee-8ac8-a4c323d79e54 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:45.378501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23b7d8-dfbf-4eee-8ac8-a4c323d79e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:45.378768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23b7d8-dfbf-4eee-8ac8-a4c323d79e54 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:45.379452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23b7d8-dfbf-4eee-8ac8-a4c323d79e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:45.379816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23b7d8-dfbf-4eee-8ac8-a4c323d79e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:45.381240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23b7d8-dfbf-4eee-8ac8-a4c323d79e54 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:45.393155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 613/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:45.399465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:45.498512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825c5c2-190c-4f92-a068-c6b15522ea57 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:45.527059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:45.533400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a82d30-db70-49a6-aaf0-4be997fa8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:45.534026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82d30-db70-49a6-aaf0-4be997fa8669 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:45.534314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82d30-db70-49a6-aaf0-4be997fa8669 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:45.534583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a82d30-db70-49a6-aaf0-4be997fa8669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:45.535301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a82d30-db70-49a6-aaf0-4be997fa8669 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=4aea4da0e5e342a39974c08bf69518e0) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:45.535606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a82d30-db70-49a6-aaf0-4be997fa8669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:45.537068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a82d30-db70-49a6-aaf0-4be997fa8669 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:45.542328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 606/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:19:45 2022] GET /identity/v3/role_assignments?user.id=4aea4da0e5e342a39974c08bf69518e0&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:47.414237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a441624-148a-4b54-b838-d7ed5067842d None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:47.414864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a441624-148a-4b54-b838-d7ed5067842d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:47.414864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a441624-148a-4b54-b838-d7ed5067842d None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:47.416151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 614/1220] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:47.421634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b262de-e8dd-4a23-be2d-ef17569e645d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:47.422087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b262de-e8dd-4a23-be2d-ef17569e645d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:47.422278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b262de-e8dd-4a23-be2d-ef17569e645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:47.440660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-65b262de-e8dd-4a23-be2d-ef17569e645d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:47.441889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-65b262de-e8dd-4a23-be2d-ef17569e645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:47.507782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 607/1221] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:19:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:19:47.776261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a441624-148a-4b54-b838-d7ed5067842d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:47.876599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a441624-148a-4b54-b838-d7ed5067842d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:47.910594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b96ab6-9687-4e94-b1a5-887b2848a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:47.911218 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96ab6-9687-4e94-b1a5-887b2848a39c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:47.911503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96ab6-9687-4e94-b1a5-887b2848a39c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:47.911768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96ab6-9687-4e94-b1a5-887b2848a39c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:47.921535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b96ab6-9687-4e94-b1a5-887b2848a39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-59b96ab6-9687-4e94-b1a5-887b2848a39c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:19:47.926161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:47.927254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:47.928252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 615/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:19:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:47.933252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b262de-e8dd-4a23-be2d-ef17569e645d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:48.034706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b262de-e8dd-4a23-be2d-ef17569e645d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:48.058207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:48.068479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:48.069082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:48.069361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:48.069661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:48.070322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:48.070629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:48.071989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:48.079753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 608/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:19:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:48.085507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b96ab6-9687-4e94-b1a5-887b2848a39c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:48.130125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:48.184464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b96ab6-9687-4e94-b1a5-887b2848a39c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:48.218037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:48.218672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:48.218934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:48.219204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:48.229410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:48.231309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:48.246529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:48.249189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:48.250397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:48.250397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:48.250397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:48.250397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 616/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:48.253533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:48.352226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92631-6aca-48ac-966d-9d232dc5eaa0 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:48.387018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:48.387664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:48.387926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:48.388198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:48.388836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:48.389138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:48.390524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:48.403489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 609/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:48.410228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:48.501622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:48.508070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038157c2-efce-4689-aa75-9e6b8e6f6085 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:48.541187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:48.541835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:48.542116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:48.542385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:48.549052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:48.550517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:19:48.562345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:48.563968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:48.565260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 617/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:48.569296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:48.616149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:48.667391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e063d-0c2d-4b31-a2a9-1c19ecabde2d None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:48.701201 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:48.701939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:48.702216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:48.702485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:48.703232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:48.703532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:48.705480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:48.722758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 610/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Aug 23 16:19:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:48.728471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:48.829675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e1579-ba6a-4040-bf6d-57095782485c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:48.863324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:48.863942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:48.864219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:48.864489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:48.883628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:48.883628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:48.890318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:48.892159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:48.893276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:48.893276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:48.893276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:48.893276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 618/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:48.897920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:48.994547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cc9dd-949c-4c5b-8b4d-9c10243e166a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:48.997131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:49.028544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:49.029139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:49.029413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:49.029719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:49.030358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:49.030652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:49.032073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:49.044225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 611/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:49.050138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:49.059562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:49.147915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee7fb8-5c14-4d76-8f1e-b02904399203 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:49.179915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:49.180528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:49.180804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:49.181073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:49.187433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:49.189462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:19:49.200986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:49.204314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:49.205456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 619/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:49.208123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:49.305368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cd719-3afa-4215-937f-65e1dd335c07 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:49.337977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90bb1b-3433-448a-9c36-d842c2b7bece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:49.338570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90bb1b-3433-448a-9c36-d842c2b7bece None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:49.338849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90bb1b-3433-448a-9c36-d842c2b7bece None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:49.339123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90bb1b-3433-448a-9c36-d842c2b7bece None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:49.339806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90bb1b-3433-448a-9c36-d842c2b7bece None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:49.340108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90bb1b-3433-448a-9c36-d842c2b7bece None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:49.341524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90bb1b-3433-448a-9c36-d842c2b7bece None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:49.353029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 612/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:19:49.359340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:49.424170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:49.458072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452399b7-c893-442e-9322-32237f64ce3f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:49.491354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178a7b-2d11-48de-8238-3205817b2787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:49.491999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178a7b-2d11-48de-8238-3205817b2787 None admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:49.492279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178a7b-2d11-48de-8238-3205817b2787 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:49.492551 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178a7b-2d11-48de-8238-3205817b2787 None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/4aea4da0e5e342a39974c08bf69518e0/roles/509e1b745fb24a048d7ff490dc477940` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:49.506613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178a7b-2d11-48de-8238-3205817b2787 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=4aea4da0e5e342a39974c08bf69518e0, role_id=509e1b745fb24a048d7ff490dc477940)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:49.508057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90178a7b-2d11-48de-8238-3205817b2787 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:49.566033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 620/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:19:49 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/4aea4da0e5e342a39974c08bf69518e0/roles/509e1b745fb24a048d7ff490dc477940 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:19:51.422657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9aa5-b686-4610-9fed-a7a8a50eb7b9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:51.423254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9aa5-b686-4610-9fed-a7a8a50eb7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:51.423254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f9aa5-b686-4610-9fed-a7a8a50eb7b9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:51.424564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 613/1233] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:51.429849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c7e95-6213-4783-a645-1e906eb87038 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:51.430288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c7e95-6213-4783-a645-1e906eb87038 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:51.430407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c7e95-6213-4783-a645-1e906eb87038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:51.447780 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d63c7e95-6213-4783-a645-1e906eb87038 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:51.448963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d63c7e95-6213-4783-a645-1e906eb87038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:51.518378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 621/1234] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:19:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:19:51.783468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f9aa5-b686-4610-9fed-a7a8a50eb7b9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:51.808190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:51.883028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f9aa5-b686-4610-9fed-a7a8a50eb7b9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:51.916465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df5bb-7af8-41ad-846b-a4270125bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:51.917084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df5bb-7af8-41ad-846b-a4270125bde5 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:51.917364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df5bb-7af8-41ad-846b-a4270125bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:51.917719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343df5bb-7af8-41ad-846b-a4270125bde5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:51.927544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343df5bb-7af8-41ad-846b-a4270125bde5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-343df5bb-7af8-41ad-846b-a4270125bde5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:19:51.932267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:51.936592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:51.937674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 614/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Tue Aug 23 16:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:51.939936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c7e95-6213-4783-a645-1e906eb87038 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:51.984826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:52.037158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c7e95-6213-4783-a645-1e906eb87038 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:52.071169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:52.071777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:52.072064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:52.072337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:52.073009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:52.073315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:52.074732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:52.083023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 622/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Tue Aug 23 16:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:52.088789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df5bb-7af8-41ad-846b-a4270125bde5 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:52.175418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:52.191035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343df5bb-7af8-41ad-846b-a4270125bde5 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:52.223598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:52.224217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:52.224495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:52.224763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:52.234501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:52.236424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:52.251721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:52.252832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:52.254009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:52.254009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:52.254009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:52.256708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 615/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:52.258687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:52.356879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a53e9-ca6c-42d8-b68a-2db57be7af49 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:52.365839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:52.390226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:52.390827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:52.391106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:52.391442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:52.392084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:52.392385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:52.393802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:52.405113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 623/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:52.410918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:52.510400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517cd0d-976d-4076-91b4-aec344c63e82 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:52.544202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:52.544876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:52.545160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:52.545433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:52.548690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:52.553568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:52.555038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:19:52.566083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:52.567253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:52.568389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 616/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:52.573111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:52.672495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36a9bb-3954-45d8-99ad-a864f37ef633 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:52.706180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:52.706781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:52.707059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:52.707330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:52.708052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:52.708378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:52.709827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:52.728263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 624/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Aug 23 16:19:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:52.734328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:52.832996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c563-7c36-40f8-b11a-fce87bf4343e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:52.866092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1e8c5-0597-4ee1-be11-4833e003d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:52.866735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e8c5-0597-4ee1-be11-4833e003d37a None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:52.867127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e8c5-0597-4ee1-be11-4833e003d37a None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:52.867404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1e8c5-0597-4ee1-be11-4833e003d37a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:52.927778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:52.933986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1e8c5-0597-4ee1-be11-4833e003d37a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:52.936875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1e8c5-0597-4ee1-be11-4833e003d37a None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:53.031407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 617/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:19:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:19:53.037920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:53.066971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:53.136201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7bfe3-6ff1-4211-912e-0c3179f0561c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:53.169015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:53.169665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:53.170068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:53.170343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:53.180102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:53.181482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:53.195401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:53.196388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:53.197320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:53.197320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:53.197320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:53.197668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 625/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:53.202277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1e8c5-0597-4ee1-be11-4833e003d37a None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:53.294045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:53.299608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1e8c5-0597-4ee1-be11-4833e003d37a None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:53.334519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:53.335115 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:53.335394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:53.335664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:53.336348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:53.336648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:53.338198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:53.349105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 618/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:53.354874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:53.432439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:53.454593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b7797-923f-4367-a802-04b1cc984361 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:53.486145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:53.486764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:53.487044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:53.487317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:53.493691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:53.495140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:19:53.506663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:53.507850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:53.508836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 626/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:53.513683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:53.614579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffd99-32ee-41b2-b804-d2752938d973 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:53.647032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b42cf-d220-49d8-bf76-a9f8b82cdcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:53.647665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b42cf-d220-49d8-bf76-a9f8b82cdcab None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:53.647947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b42cf-d220-49d8-bf76-a9f8b82cdcab None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:53.648220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b42cf-d220-49d8-bf76-a9f8b82cdcab None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:53.648910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b42cf-d220-49d8-bf76-a9f8b82cdcab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:53.649216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b42cf-d220-49d8-bf76-a9f8b82cdcab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:53.650668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b42cf-d220-49d8-bf76-a9f8b82cdcab None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:53.663175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 619/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:53.669492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:53.767990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc49cb-ccf8-4e3e-a918-4051419cb38f None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:53.800574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0476f-30fc-49b0-916b-d27d1177f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:53.801169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0476f-30fc-49b0-916b-d27d1177f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:53.801445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0476f-30fc-49b0-916b-d27d1177f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:53.801743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0476f-30fc-49b0-916b-d27d1177f3e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:53.802458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0476f-30fc-49b0-916b-d27d1177f3e5 None admin] RBAC: Adding query filter params (role.id=509e1b745fb24a048d7ff490dc477940, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=4aea4da0e5e342a39974c08bf69518e0) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:53.802762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0476f-30fc-49b0-916b-d27d1177f3e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:53.804188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0476f-30fc-49b0-916b-d27d1177f3e5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:53.809741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 627/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:19:53 2022] GET /identity/v3/role_assignments?user.id=4aea4da0e5e342a39974c08bf69518e0&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=509e1b745fb24a048d7ff490dc477940 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:55.801272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd789f-ee08-4907-8fff-c7f2a5726970 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:55.801867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd789f-ee08-4907-8fff-c7f2a5726970 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:55.801867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd789f-ee08-4907-8fff-c7f2a5726970 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:55.803199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 620/1247] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:55.808541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628366-8c69-4ba8-bfc1-aa9236e25a11 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:55.808948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628366-8c69-4ba8-bfc1-aa9236e25a11 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:55.809115 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628366-8c69-4ba8-bfc1-aa9236e25a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:55.815950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:55.827740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-26628366-8c69-4ba8-bfc1-aa9236e25a11 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:55.829521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-26628366-8c69-4ba8-bfc1-aa9236e25a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:55.896501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 628/1248] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:19:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:19:56.165371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd789f-ee08-4907-8fff-c7f2a5726970 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:56.183827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:56.266602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd789f-ee08-4907-8fff-c7f2a5726970 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:56.300856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fbd55-c9e6-472c-90b3-c964a00cd887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:56.301553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbd55-c9e6-472c-90b3-c964a00cd887 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:56.301881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbd55-c9e6-472c-90b3-c964a00cd887 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:56.302155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fbd55-c9e6-472c-90b3-c964a00cd887 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:56.312154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fbd55-c9e6-472c-90b3-c964a00cd887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-e03fbd55-c9e6-472c-90b3-c964a00cd887 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:19:56.316746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:56.317839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:56.318902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 621/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:19:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:56.324084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628366-8c69-4ba8-bfc1-aa9236e25a11 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:56.421431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628366-8c69-4ba8-bfc1-aa9236e25a11 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:56.450667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:56.455558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:56.456164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:56.456434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:56.456705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:56.457359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:56.457683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:56.459046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:56.466783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 629/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:56.473325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fbd55-c9e6-472c-90b3-c964a00cd887 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:56.549562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:56.571247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fbd55-c9e6-472c-90b3-c964a00cd887 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:56.604054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:56.604673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:56.609528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:56.609528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:56.615687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:56.617178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:56.631889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:56.632876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:56.633884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:56.633884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:56.633884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:56.634100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 622/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:56.639182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:56.735009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d860f-9bda-4825-bb72-0be5a9ed52a5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:56.768247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:56.768846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:56.769130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:56.769406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:56.770173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:56.770487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:56.771962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:56.783913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 630/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:56.789593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:56.887873 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6f2e2-e03c-4dc2-a7d1-2bbd182e68c8 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:56.913876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:56.921633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:56.922279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:56.922582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:56.922861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:56.931755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:56.933208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:19:56.944514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:56.945703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:19:56.946832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 623/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:56.951542 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:57.008520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:57.052971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813abba8-066e-4904-9904-7e5dae2281dc None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:57.087384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:57.087997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:57.088284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:57.088562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:57.089293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:57.089600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:57.091147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:57.108042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 631/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Aug 23 16:19:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:57.113895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:57.212282 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36f6c4-d4f7-476d-b4fa-7aca94ce2655 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:57.245405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238392e-0d54-4554-832b-791cc5b28e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:57.246033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238392e-0d54-4554-832b-791cc5b28e6e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:57.246312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238392e-0d54-4554-832b-791cc5b28e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:57.246840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238392e-0d54-4554-832b-791cc5b28e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:57.300192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:57.311725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238392e-0d54-4554-832b-791cc5b28e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:57.313162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238392e-0d54-4554-832b-791cc5b28e6e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:57.413216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 624/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:19:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:19:57.419066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:57.517401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1fbd4-383c-4e6b-98e7-94191d351611 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:57.530108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:57.550708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:57.551321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:57.551598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:57.551869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:57.561305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:57.562773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:19:57.576624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:57.577838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:19:57.579487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:19:57.579487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:19:57.579487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:57.579487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 632/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:57.583989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238392e-0d54-4554-832b-791cc5b28e6e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:57.670479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:57.682178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238392e-0d54-4554-832b-791cc5b28e6e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:57.715537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:57.716138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:57.716418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:57.716691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:57.717321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:57.717649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:57.719050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:57.730580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 625/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:57.736401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:57.837328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02487128-2f90-436d-b7c3-cd7cb490077d None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:57.869719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:57.874576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:57.874576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:57.874576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:57.878101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:57.879544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:19:57.890404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:19:57.892015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:19:57.893307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 633/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:19:57.898082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:57.997887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddf4f-62be-4e64-803c-cc39c9c55d6e None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:58.033027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7309a-48e3-4fd5-bed6-df42c5d39f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:58.033653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7309a-48e3-4fd5-bed6-df42c5d39f33 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:58.033935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7309a-48e3-4fd5-bed6-df42c5d39f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:58.034204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7309a-48e3-4fd5-bed6-df42c5d39f33 None admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:58.034891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7309a-48e3-4fd5-bed6-df42c5d39f33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:58.035318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7309a-48e3-4fd5-bed6-df42c5d39f33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:58.036734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7309a-48e3-4fd5-bed6-df42c5d39f33 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:58.048616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 626/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:19:58.054880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:58.085493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:58.161739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc755-fc52-427d-95b9-1c89e493ed94 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:58.195725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c182dd4-767b-4525-b0ef-53c9ab25daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:58.196315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c182dd4-767b-4525-b0ef-53c9ab25daee None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:58.196596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c182dd4-767b-4525-b0ef-53c9ab25daee None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:58.196860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c182dd4-767b-4525-b0ef-53c9ab25daee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:58.197589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c182dd4-767b-4525-b0ef-53c9ab25daee None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=4aea4da0e5e342a39974c08bf69518e0) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:19:58.197905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c182dd4-767b-4525-b0ef-53c9ab25daee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:58.199310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c182dd4-767b-4525-b0ef-53c9ab25daee None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:58.204559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 634/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:19:58 2022] GET /identity/v3/role_assignments?user.id=4aea4da0e5e342a39974c08bf69518e0&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:00.102084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dda60-3723-4792-b73f-2a3c6bdac499 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:00.102605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dda60-3723-4792-b73f-2a3c6bdac499 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:00.102745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dda60-3723-4792-b73f-2a3c6bdac499 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:00.103972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 627/1261] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:00.109129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04229b7b-a465-48e6-9b10-9e3331ac16e5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:00.109562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04229b7b-a465-48e6-9b10-9e3331ac16e5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:00.109697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04229b7b-a465-48e6-9b10-9e3331ac16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:00.128021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-04229b7b-a465-48e6-9b10-9e3331ac16e5 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:00.129209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-04229b7b-a465-48e6-9b10-9e3331ac16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:00.193744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 635/1262] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:20:00.458582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dda60-3723-4792-b73f-2a3c6bdac499 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:00.469398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:00.560067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dda60-3723-4792-b73f-2a3c6bdac499 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:00.594752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5f613-57b4-4013-b645-d50be16e3ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:00.595365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5f613-57b4-4013-b645-d50be16e3ffd None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:00.595642 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5f613-57b4-4013-b645-d50be16e3ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:00.595911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5f613-57b4-4013-b645-d50be16e3ffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:00.605812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5f613-57b4-4013-b645-d50be16e3ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-53c5f613-57b4-4013-b645-d50be16e3ffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:20:00.611406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:00.612398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:20:00.613376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 628/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:00.618724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04229b7b-a465-48e6-9b10-9e3331ac16e5 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:00.637663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:00.717660 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04229b7b-a465-48e6-9b10-9e3331ac16e5 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:00.751356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:00.751973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:00.752257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:00.752535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:00.753198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:00.753503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:00.754918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:00.762801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 636/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:00.768670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5f613-57b4-4013-b645-d50be16e3ffd None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:00.835488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:00.868573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5f613-57b4-4013-b645-d50be16e3ffd None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:00.900506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:00.901128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:00.901412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:00.901714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:00.912682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:00.914191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:20:00.929723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:00.930970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:20:00.932138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:20:00.932138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:20:00.932138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:20:00.932138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 629/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:00.936734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:01.023211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:01.040991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a674d8-124a-40fd-9330-ed5d3cd61cd8 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:01.074595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:01.075194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.075463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.078541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.078541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:01.078541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:01.078541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:01.088733 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 637/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:01.095047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:01.193845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f874e-02dd-4b8f-9697-de87da657334 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:01.213535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:01.227758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:01.228381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.228661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.228937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.236066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:01.237496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:20:01.248455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:01.255741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:20:01.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 630/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:20:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:01.257640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:01.354544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eca653-bee7-4923-9951-4c0da4385cba None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:01.386905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:01.387506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.387790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.388074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.388784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:01.389088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:01.390546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:01.400948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:01.409636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 638/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Aug 23 16:20:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:01.415581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:01.517186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb3bd5-9a6c-437e-bcfb-c18a75d5766c None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:01.550518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:01.551137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.551418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.551687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.561988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:01.563949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:20:01.577593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:01.578759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:20:01.580465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:20:01.580465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:20:01.580465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:20:01.580465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 631/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:01.585424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:01.684742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d095f23-2704-4a32-ad04-9cc5ce071ed5 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:01.719071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:01.719671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.719952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.720226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.720868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:01.721170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:01.722605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:01.733737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 639/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:01.739938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:01.772462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:01.840181 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897bb99-8832-430e-a2ee-5989dbfefe93 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:01.873731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:01.874353 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.874633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.874964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.881966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:01.883395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:20:01.894811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:01.895871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:20:01.896785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 632/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:01.902001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:01.960421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:02.000704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7b5e-8ac1-43e1-b941-ca59010f538c None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:02.034661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1483720-f496-4605-81ff-c39a8eaa2315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:02.035270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1483720-f496-4605-81ff-c39a8eaa2315 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:02.035551 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1483720-f496-4605-81ff-c39a8eaa2315 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:02.035823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1483720-f496-4605-81ff-c39a8eaa2315 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:02.036520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1483720-f496-4605-81ff-c39a8eaa2315 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:02.036842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1483720-f496-4605-81ff-c39a8eaa2315 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:02.038288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1483720-f496-4605-81ff-c39a8eaa2315 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:02.049961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 640/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:02.056267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:02.151744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:02.160676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b663e2f-ceed-4be1-9b2c-f1dd0f50588b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:02.192916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe69676-f614-4827-a7dc-6333c46fa4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:02.193553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69676-f614-4827-a7dc-6333c46fa4a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:02.193858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69676-f614-4827-a7dc-6333c46fa4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:02.194128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe69676-f614-4827-a7dc-6333c46fa4a5 None admin] PATH_INFO: `/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/4aea4da0e5e342a39974c08bf69518e0/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:02.196106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69676-f614-4827-a7dc-6333c46fa4a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c90205ba53c4412a86dce8c2103ea7a, user_id=4aea4da0e5e342a39974c08bf69518e0, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:02.197519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe69676-f614-4827-a7dc-6333c46fa4a5 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:02.304177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 633/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Tue Aug 23 16:20:02 2022] PUT /identity/v3/projects/8c90205ba53c4412a86dce8c2103ea7a/users/4aea4da0e5e342a39974c08bf69518e0/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:20:04.182638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bf8d-4fcd-4fa8-9489-4b8a5e405e0f None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:04.183197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bf8d-4fcd-4fa8-9489-4b8a5e405e0f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:04.183197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bf8d-4fcd-4fa8-9489-4b8a5e405e0f None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:04.184714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 641/1274] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:04.189863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285575-fd2f-4dcb-ad9f-f5d5e492e6e6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:04.190294 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285575-fd2f-4dcb-ad9f-f5d5e492e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:04.190413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47285575-fd2f-4dcb-ad9f-f5d5e492e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:04.208857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-47285575-fd2f-4dcb-ad9f-f5d5e492e6e6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:04.210088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-47285575-fd2f-4dcb-ad9f-f5d5e492e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:04.277217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 634/1275] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:20:04.545645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477bf8d-4fcd-4fa8-9489-4b8a5e405e0f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:04.654154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477bf8d-4fcd-4fa8-9489-4b8a5e405e0f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:04.673672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:04.691588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1e666-7aca-4250-8059-5751413ba6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:04.692246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e666-7aca-4250-8059-5751413ba6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:04.692544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e666-7aca-4250-8059-5751413ba6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:04.692797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1e666-7aca-4250-8059-5751413ba6a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:04.705266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1e666-7aca-4250-8059-5751413ba6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-b3c1e666-7aca-4250-8059-5751413ba6a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:20:04.710134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:04.711127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:04.712140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 642/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Tue Aug 23 16:20:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:04.717672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47285575-fd2f-4dcb-ad9f-f5d5e492e6e6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:04.809291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:04.828820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47285575-fd2f-4dcb-ad9f-f5d5e492e6e6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:04.864249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:04.864923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:04.865205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:04.865474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:04.866216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:04.866515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:04.868043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:04.879100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 635/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Tue Aug 23 16:20:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:20:04.885063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1e666-7aca-4250-8059-5751413ba6a3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:04.989262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1e666-7aca-4250-8059-5751413ba6a3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:05.026460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:05.027113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:05.027395 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:05.027664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:05.039960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:05.041568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:20:05.057316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:05.058421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:20:05.065802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:20:05.065802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:20:05.065802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:05.065802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 643/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:05.066126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:05.163224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aad49f-c2c1-4592-9d68-432003b242d4 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:05.195732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:05.196333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:05.196599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:05.196874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:05.197508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:05.197844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:05.199205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:05.211266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 636/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:05.217048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:05.247720 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:05.315418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245bc44-9e18-4202-b925-82d2f4701ecd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:05.348508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:05.349132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:05.349408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:05.349711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:05.356439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:05.357903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:20:05.369023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:05.370314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:05.371512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 644/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:20:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:05.376740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:05.380490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:05.476314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907b996-c09a-470c-98c3-1c196a3e9f87 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:05.510670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:05.511262 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:05.511541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:05.511810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:05.512530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:05.512828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:05.514276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:05.530575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 637/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Tue Aug 23 16:20:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:05.536908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:05.625108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:05.634695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831bdbf-b5d8-4ec4-a655-0e505ac340b0 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:05.667424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda233bd-c67a-4bb9-8819-550e1daa2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:05.668022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda233bd-c67a-4bb9-8819-550e1daa2612 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:05.668300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda233bd-c67a-4bb9-8819-550e1daa2612 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:05.668571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda233bd-c67a-4bb9-8819-550e1daa2612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:05.736199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda233bd-c67a-4bb9-8819-550e1daa2612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:05.741155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda233bd-c67a-4bb9-8819-550e1daa2612 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:05.832299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:05.842901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 645/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Tue Aug 23 16:20:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:20:05.849842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:05.911339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:05.948576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550300ba-69c9-46db-add0-5be261b95b0b None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:05.983911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:05.984535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:05.984818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:05.985128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:05.994968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:05.996400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:20:06.011233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:06.012400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:20:06.013738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:20:06.013738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:20:06.013738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:20:06.013738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 638/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:06.018687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda233bd-c67a-4bb9-8819-550e1daa2612 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:06.117176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda233bd-c67a-4bb9-8819-550e1daa2612 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:06.151315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:06.151916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:06.152210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:06.152528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:06.153172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:06.153474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:06.154870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:06.165998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 646/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Tue Aug 23 16:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:20:06.171586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:06.270513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafc532-aedf-46ba-bb55-5f96bb5bfb03 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:06.283996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:06.303672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:06.304297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:06.304585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:06.304858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:06.311301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:06.312729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:20:06.324552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:06.325637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: ERROR keystone.server.flask.application Aug 23 16:20:06.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 639/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Tue Aug 23 16:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:06.332223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:06.382004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:06.433296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613294e9-6c0b-4db6-a7d4-a409cdd954a3 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:06.470262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226d53d-b765-40a9-bf53-1857d1a05182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:06.471302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d53d-b765-40a9-bf53-1857d1a05182 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:06.471737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d53d-b765-40a9-bf53-1857d1a05182 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:06.472015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d53d-b765-40a9-bf53-1857d1a05182 None admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:06.472752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226d53d-b765-40a9-bf53-1857d1a05182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:06.473056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226d53d-b765-40a9-bf53-1857d1a05182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:06.474543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226d53d-b765-40a9-bf53-1857d1a05182 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:06.489319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 647/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Tue Aug 23 16:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:06.495488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:06.601830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a65b1-5410-4ad0-b9f4-9fb1c12d5259 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:06.634815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56dc10-1a8a-4c7d-817f-9c153af55c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:06.635402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dc10-1a8a-4c7d-817f-9c153af55c84 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:06.635678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dc10-1a8a-4c7d-817f-9c153af55c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:06.635960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56dc10-1a8a-4c7d-817f-9c153af55c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:06.636676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56dc10-1a8a-4c7d-817f-9c153af55c84 None admin] RBAC: Adding query filter params (role.id=896aa4932a1a46dabc0e1036ad2f44de, scope.project.id=8c90205ba53c4412a86dce8c2103ea7a, user.id=4aea4da0e5e342a39974c08bf69518e0) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:06.636963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56dc10-1a8a-4c7d-817f-9c153af55c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:06.638472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56dc10-1a8a-4c7d-817f-9c153af55c84 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:06.644757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 640/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Tue Aug 23 16:20:06 2022] GET /identity/v3/role_assignments?user.id=4aea4da0e5e342a39974c08bf69518e0&scope.project.id=8c90205ba53c4412a86dce8c2103ea7a&role.id=896aa4932a1a46dabc0e1036ad2f44de => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:08.572160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdf20-7b48-41ba-b0d3-7ceada42f1fb None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:08.572698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdf20-7b48-41ba-b0d3-7ceada42f1fb None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:08.572792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acdf20-7b48-41ba-b0d3-7ceada42f1fb None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:08.574135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 648/1288] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:08.579248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7242d-30b3-4c8c-a475-37eddc34030a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:08.579695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7242d-30b3-4c8c-a475-37eddc34030a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:08.579792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7242d-30b3-4c8c-a475-37eddc34030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:08.598220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e9f7242d-30b3-4c8c-a475-37eddc34030a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:08.599557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e9f7242d-30b3-4c8c-a475-37eddc34030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:08.629326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:08.666473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 641/1289] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:20:08.942501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acdf20-7b48-41ba-b0d3-7ceada42f1fb None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:09.047305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acdf20-7b48-41ba-b0d3-7ceada42f1fb None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:09.058322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:09.083600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:09.085521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:09.085521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:09.085521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:09.085521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:09.087793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:09.104232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:09.105584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:09.106699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 649/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:20:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:09.111736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7242d-30b3-4c8c-a475-37eddc34030a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:09.217070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7242d-30b3-4c8c-a475-37eddc34030a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:09.250885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c1d8c-9f68-40ca-a566-bf3409e80316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:09.252300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c1d8c-9f68-40ca-a566-bf3409e80316 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:09.252664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c1d8c-9f68-40ca-a566-bf3409e80316 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:09.252935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c1d8c-9f68-40ca-a566-bf3409e80316 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:09.253562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c1d8c-9f68-40ca-a566-bf3409e80316 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:09.253887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c1d8c-9f68-40ca-a566-bf3409e80316 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:09.255373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c1d8c-9f68-40ca-a566-bf3409e80316 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:09.260709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 642/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Tue Aug 23 16:20:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:09.267583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:09.368039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f0c8c-fc6a-4dd9-a446-af89d4b2fcfd None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:09.404400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11de6-b896-47a7-b244-f9165ae42104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:09.405008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11de6-b896-47a7-b244-f9165ae42104 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:09.405289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11de6-b896-47a7-b244-f9165ae42104 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:09.405745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11de6-b896-47a7-b244-f9165ae42104 None admin] PATH_INFO: `/v3/services` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:09.406884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f11de6-b896-47a7-b244-f9165ae42104 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:09.407442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f11de6-b896-47a7-b244-f9165ae42104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:09.409990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f11de6-b896-47a7-b244-f9165ae42104 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:09.414997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 650/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Tue Aug 23 16:20:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:11.300521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa861-2703-4961-8710-5a400c21e895 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:11.301056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa861-2703-4961-8710-5a400c21e895 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:11.301056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa861-2703-4961-8710-5a400c21e895 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:11.302438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 643/1293] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:11.307633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e49ad9-0177-4da1-b1a6-2365d7d5d6de None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:11.308049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e49ad9-0177-4da1-b1a6-2365d7d5d6de None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:11.308168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e49ad9-0177-4da1-b1a6-2365d7d5d6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:11.326415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-08e49ad9-0177-4da1-b1a6-2365d7d5d6de None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:11.327587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-08e49ad9-0177-4da1-b1a6-2365d7d5d6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:11.357140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:11.394040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 651/1294] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:20:11.664838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaa861-2703-4961-8710-5a400c21e895 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:11.696798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:11.765945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaa861-2703-4961-8710-5a400c21e895 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:11.799793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ab66-fbd7-4c60-86d4-68837f94577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:11.800380 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ab66-fbd7-4c60-86d4-68837f94577b None admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:11.800659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ab66-fbd7-4c60-86d4-68837f94577b None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:11.800928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ab66-fbd7-4c60-86d4-68837f94577b None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:11.801571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ab66-fbd7-4c60-86d4-68837f94577b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:11.802960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ab66-fbd7-4c60-86d4-68837f94577b None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:11.921653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 644/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Tue Aug 23 16:20:11 2022] POST /identity/v3/services => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:20:13.816756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b20d6-9c61-4c47-a4cf-e0ec96486963 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:13.817305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b20d6-9c61-4c47-a4cf-e0ec96486963 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:13.817426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b20d6-9c61-4c47-a4cf-e0ec96486963 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:13.819084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 652/1296] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:13.824450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe633-cbab-4303-96af-da75e04a2a24 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:13.824914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe633-cbab-4303-96af-da75e04a2a24 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:13.825008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe633-cbab-4303-96af-da75e04a2a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:13.843401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1acfe633-cbab-4303-96af-da75e04a2a24 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:13.844602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1acfe633-cbab-4303-96af-da75e04a2a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:13.918224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 645/1297] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:20:14.186347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b20d6-9c61-4c47-a4cf-e0ec96486963 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:14.288180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b20d6-9c61-4c47-a4cf-e0ec96486963 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:14.321477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:14.322128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:14.322410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:14.322684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:14.323257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:14.324642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:14.333849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:14.335051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:14.336107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 653/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:20:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:14.343437 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe633-cbab-4303-96af-da75e04a2a24 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:14.362290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:14.443049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe633-cbab-4303-96af-da75e04a2a24 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:14.476703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:14.477325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:14.477631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:14.477908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:14.478550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:14.478855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:14.480238 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:14.485831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 646/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Tue Aug 23 16:20:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:14.492464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:14.524788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:14.593352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77970eb-8b53-4965-a7bb-376f7151bd12 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:14.627121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1006f-08e0-4b52-9c08-c9ab69ff2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:14.627727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1006f-08e0-4b52-9c08-c9ab69ff2612 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:14.628007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1006f-08e0-4b52-9c08-c9ab69ff2612 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:14.628281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1006f-08e0-4b52-9c08-c9ab69ff2612 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:14.628985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1006f-08e0-4b52-9c08-c9ab69ff2612 None admin] RBAC: Adding query filter params (interface=public, service_id=af896fac36eb499cbcecd3c1c10bbb09, region_id=RegionOne) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:14.629291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1006f-08e0-4b52-9c08-c9ab69ff2612 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:14.630695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1006f-08e0-4b52-9c08-c9ab69ff2612 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:14.635622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 654/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Tue Aug 23 16:20:14 2022] GET /identity/v3/endpoints?service_id=af896fac36eb499cbcecd3c1c10bbb09&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:14.641589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:14.722298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:14.740168 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07615c9a-02a5-4854-9b29-4bcc698b9296 None admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:14.774797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16897-8f92-4944-bbaa-4193b6348418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:14.775467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16897-8f92-4944-bbaa-4193b6348418 None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:14.775754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16897-8f92-4944-bbaa-4193b6348418 None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:14.776026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16897-8f92-4944-bbaa-4193b6348418 None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:14.776628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16897-8f92-4944-bbaa-4193b6348418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:14.778022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16897-8f92-4944-bbaa-4193b6348418 None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:14.784696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 647/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Tue Aug 23 16:20:14 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:20:16.677883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368b0e5-fc6b-4fab-96b7-1bd27caf9f6f None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:16.678471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368b0e5-fc6b-4fab-96b7-1bd27caf9f6f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:16.678471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368b0e5-fc6b-4fab-96b7-1bd27caf9f6f None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:16.680131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 655/1302] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:16.685024 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304aa2-3702-4ad9-84a3-2189321d3084 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:16.685463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304aa2-3702-4ad9-84a3-2189321d3084 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:16.685630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304aa2-3702-4ad9-84a3-2189321d3084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:16.703676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-39304aa2-3702-4ad9-84a3-2189321d3084 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:16.705463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-39304aa2-3702-4ad9-84a3-2189321d3084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:16.770746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 648/1303] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:20:17.039504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368b0e5-fc6b-4fab-96b7-1bd27caf9f6f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:17.135686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:17.143061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368b0e5-fc6b-4fab-96b7-1bd27caf9f6f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:17.175899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:17.176520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:17.176797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:17.177070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:17.177718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:17.179073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:20:17.187713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:20:17.189536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application with Lock( Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: ERROR keystone.server.flask.application Aug 23 16:20:17.190702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 656/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Tue Aug 23 16:20:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:20:17.197929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304aa2-3702-4ad9-84a3-2189321d3084 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:17.273219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:17.295840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304aa2-3702-4ad9-84a3-2189321d3084 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:17.329789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24421b6-45ba-4fd6-af8b-2a4cc15d535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:17.330386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24421b6-45ba-4fd6-af8b-2a4cc15d535e None admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:17.330664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24421b6-45ba-4fd6-af8b-2a4cc15d535e None admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:17.330935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24421b6-45ba-4fd6-af8b-2a4cc15d535e None admin] PATH_INFO: `/v3/services` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:17.331559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24421b6-45ba-4fd6-af8b-2a4cc15d535e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:20:17.331860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24421b6-45ba-4fd6-af8b-2a4cc15d535e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:17.333215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24421b6-45ba-4fd6-af8b-2a4cc15d535e None admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:17.338294 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 649/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Tue Aug 23 16:20:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:20:17.344217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:17.443833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9a318-8cfc-44b8-a213-f09d6e0a1787 None admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:17.476882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a4be-c8c1-4655-8341-a1168ee75066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:17.477479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a4be-c8c1-4655-8341-a1168ee75066 None admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:17.477793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a4be-c8c1-4655-8341-a1168ee75066 None admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:17.478104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a4be-c8c1-4655-8341-a1168ee75066 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:17.478783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1a4be-c8c1-4655-8341-a1168ee75066 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:17.480210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1a4be-c8c1-4655-8341-a1168ee75066 None admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:17.567168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 657/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:20:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:20:27.335252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=30 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:27.562392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.206884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08944b72-e62f-4253-88e3-a0da41ba429f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.207931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08944b72-e62f-4253-88e3-a0da41ba429f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.208443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08944b72-e62f-4253-88e3-a0da41ba429f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.216522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ed0a-74f5-450d-a65b-842875c11d92 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.218137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ed0a-74f5-450d-a65b-842875c11d92 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.218721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5ed0a-74f5-450d-a65b-842875c11d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.221910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 650/1307] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:00 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:00.294909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ecb5ed0a-74f5-450d-a65b-842875c11d92 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:00.297274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ecb5ed0a-74f5-450d-a65b-842875c11d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:00.430237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 658/1308] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:26:00.779022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9721a-7e77-4fb5-879d-401df670071e None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.780022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9721a-7e77-4fb5-879d-401df670071e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.780394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9721a-7e77-4fb5-879d-401df670071e None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.782049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 651/1309] 10.222.0.61 () {54 vars in 965 bytes} [Tue Aug 23 16:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:00.788467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1de07d-1e9c-4161-8c2a-3d1668ff3961 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:00.788884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1de07d-1e9c-4161-8c2a-3d1668ff3961 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:00.789231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1de07d-1e9c-4161-8c2a-3d1668ff3961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:00.873265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7c1de07d-1e9c-4161-8c2a-3d1668ff3961 None None] MFA Rules not processed for user `3d5b15e9f0414836b3611a8ff6085b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:00.874651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7c1de07d-1e9c-4161-8c2a-3d1668ff3961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:00.896448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:00.959546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 659/1310] 10.222.0.61 () {58 vars in 1062 bytes} [Tue Aug 23 16:26:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:00.968905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9721a-7e77-4fb5-879d-401df670071e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:00.970796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9ed9721a-7e77-4fb5-879d-401df670071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:01.106568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9721a-7e77-4fb5-879d-401df670071e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:01.188006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f059aa-dac2-4019-ad2a-1bc5b1ef0ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:01.188618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f059aa-dac2-4019-ad2a-1bc5b1ef0ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:01.188900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f059aa-dac2-4019-ad2a-1bc5b1ef0ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:01.189170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f059aa-dac2-4019-ad2a-1bc5b1ef0ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:01.190813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c3f059aa-dac2-4019-ad2a-1bc5b1ef0ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:01.248610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:01.305020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f059aa-dac2-4019-ad2a-1bc5b1ef0ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:01.306505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f059aa-dac2-4019-ad2a-1bc5b1ef0ad0 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:01.326707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 652/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:03.625086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027e49-6235-4bca-b5ec-02a00ead9772 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:03.625738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027e49-6235-4bca-b5ec-02a00ead9772 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:03.625738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19027e49-6235-4bca-b5ec-02a00ead9772 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:03.628603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 660/1312] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:03.632787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46370d-a10a-4041-91df-588b7e99f064 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:03.633301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46370d-a10a-4041-91df-588b7e99f064 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:03.633301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46370d-a10a-4041-91df-588b7e99f064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:03.726639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0d46370d-a10a-4041-91df-588b7e99f064 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:03.726639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0d46370d-a10a-4041-91df-588b7e99f064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:03.827488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 653/1313] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:04.106536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027e49-6235-4bca-b5ec-02a00ead9772 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:04.108127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-19027e49-6235-4bca-b5ec-02a00ead9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:04.208828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19027e49-6235-4bca-b5ec-02a00ead9772 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:04.282103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:04.285012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da4ee8-31b1-4f26-89d3-5d95d887646d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:04.285749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4ee8-31b1-4f26-89d3-5d95d887646d service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:04.286082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4ee8-31b1-4f26-89d3-5d95d887646d service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:04.286409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da4ee8-31b1-4f26-89d3-5d95d887646d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:04.288248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-96da4ee8-31b1-4f26-89d3-5d95d887646d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:04.413091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da4ee8-31b1-4f26-89d3-5d95d887646d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:04.414814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da4ee8-31b1-4f26-89d3-5d95d887646d service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:04.435901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 661/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:06.861677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c222-7a21-4057-990d-43e8282c3a69 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.862268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c222-7a21-4057-990d-43e8282c3a69 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.862268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33c222-7a21-4057-990d-43e8282c3a69 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.863576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 654/1315] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:26:06.868893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe49b9a-628f-4a6f-853a-cf82a8462422 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:06.869545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe49b9a-628f-4a6f-853a-cf82a8462422 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:06.869746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe49b9a-628f-4a6f-853a-cf82a8462422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:06.933765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-cfe49b9a-628f-4a6f-853a-cf82a8462422 None None] MFA Rules not processed for user `e585ef5ba4f347e99c8c23cbb6cb501a`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:06.934987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cfe49b9a-628f-4a6f-853a-cf82a8462422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:06.985887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.030167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 662/1316] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:07.349151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33c222-7a21-4057-990d-43e8282c3a69 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:07.350953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-af33c222-7a21-4057-990d-43e8282c3a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:07.362891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.467050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33c222-7a21-4057-990d-43e8282c3a69 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:07.540453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964b634-4060-4b43-bc14-669a36256a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:07.541056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964b634-4060-4b43-bc14-669a36256a97 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:07.541334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964b634-4060-4b43-bc14-669a36256a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:07.541621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964b634-4060-4b43-bc14-669a36256a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:07.543228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d964b634-4060-4b43-bc14-669a36256a97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:07.605251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:07.652031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964b634-4060-4b43-bc14-669a36256a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:07.653460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964b634-4060-4b43-bc14-669a36256a97 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:07.672993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 655/1317] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:10.503637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c10d-4344-4f68-8373-4203a8deff04 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:10.504211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c10d-4344-4f68-8373-4203a8deff04 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:10.504211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c10d-4344-4f68-8373-4203a8deff04 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:10.505514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 663/1318] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:10.510847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a665-7926-41c5-b1ab-5d9c6f11c7c2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:10.511304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a665-7926-41c5-b1ab-5d9c6f11c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:10.511410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a665-7926-41c5-b1ab-5d9c6f11c7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:10.575381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bf98a665-7926-41c5-b1ab-5d9c6f11c7c2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:10.577077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bf98a665-7926-41c5-b1ab-5d9c6f11c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:10.671243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 656/1319] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:10.954434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8c10d-4344-4f68-8373-4203a8deff04 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:10.955986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f1e8c10d-4344-4f68-8373-4203a8deff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:11.055993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8c10d-4344-4f68-8373-4203a8deff04 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:11.127477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cb2bc-d01e-4004-bcca-f168df44740d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:11.128074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb2bc-d01e-4004-bcca-f168df44740d service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:11.128358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb2bc-d01e-4004-bcca-f168df44740d service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:11.128629 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb2bc-d01e-4004-bcca-f168df44740d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:11.130241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-234cb2bc-d01e-4004-bcca-f168df44740d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:11.137384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:11.240299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cb2bc-d01e-4004-bcca-f168df44740d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:11.241686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cb2bc-d01e-4004-bcca-f168df44740d service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:11.259855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 664/1320] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:14.161555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99caf-e16f-4b23-99a3-4f36a2408349 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:14.162182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99caf-e16f-4b23-99a3-4f36a2408349 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:14.162182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99caf-e16f-4b23-99a3-4f36a2408349 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:14.163504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 657/1321] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:14.169089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750943-539e-4053-95de-9e1c349edd4d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:14.170171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750943-539e-4053-95de-9e1c349edd4d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:14.170284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b750943-539e-4053-95de-9e1c349edd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:14.235398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4b750943-539e-4053-95de-9e1c349edd4d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:14.236511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4b750943-539e-4053-95de-9e1c349edd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:14.292425 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:14.331625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 665/1322] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:14.614145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99caf-e16f-4b23-99a3-4f36a2408349 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:14.615777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-93a99caf-e16f-4b23-99a3-4f36a2408349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:14.636819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:14.725512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99caf-e16f-4b23-99a3-4f36a2408349 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:14.799953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cc775-5248-4940-8018-5f665423db31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:14.800562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc775-5248-4940-8018-5f665423db31 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:14.800844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc775-5248-4940-8018-5f665423db31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:14.801114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc775-5248-4940-8018-5f665423db31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:14.802732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0c8cc775-5248-4940-8018-5f665423db31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:14.872500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:14.910725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cc775-5248-4940-8018-5f665423db31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:14.912181 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cc775-5248-4940-8018-5f665423db31 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:14.930024 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 658/1323] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:16.907912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011290-ca82-44e0-9403-a23307aee092 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.908480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011290-ca82-44e0-9403-a23307aee092 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.908480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c011290-ca82-44e0-9403-a23307aee092 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.909863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 666/1324] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:16.915085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c1a15-2055-43d7-ab1e-092ac43512d3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:16.915545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c1a15-2055-43d7-ab1e-092ac43512d3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:16.915663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c1a15-2055-43d7-ab1e-092ac43512d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:16.981874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-394c1a15-2055-43d7-ab1e-092ac43512d3 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:16.983093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-394c1a15-2055-43d7-ab1e-092ac43512d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:17.085713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 659/1325] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:17.381157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07116a6-10dd-4249-88d8-a5b7f4e65c34 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.381565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07116a6-10dd-4249-88d8-a5b7f4e65c34 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.381937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07116a6-10dd-4249-88d8-a5b7f4e65c34 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.383438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 667/1326] 10.222.0.61 () {54 vars in 965 bytes} [Tue Aug 23 16:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:17.391185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634255d-43a3-4e53-8850-726afdc697cf None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.394784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634255d-43a3-4e53-8850-726afdc697cf None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.394784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634255d-43a3-4e53-8850-726afdc697cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.424652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:17.469025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c634255d-43a3-4e53-8850-726afdc697cf None None] MFA Rules not processed for user `3d5b15e9f0414836b3611a8ff6085b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:17.470242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c634255d-43a3-4e53-8850-726afdc697cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:17.548265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 660/1327] 10.222.0.61 () {58 vars in 1062 bytes} [Tue Aug 23 16:26:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:17.557431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07116a6-10dd-4249-88d8-a5b7f4e65c34 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:17.559082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b07116a6-10dd-4249-88d8-a5b7f4e65c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:17.673182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07116a6-10dd-4249-88d8-a5b7f4e65c34 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:17.746939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9006487-8bad-4c84-9752-4a285e7995ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:17.747547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9006487-8bad-4c84-9752-4a285e7995ac service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:17.747967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9006487-8bad-4c84-9752-4a285e7995ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:17.748245 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9006487-8bad-4c84-9752-4a285e7995ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:17.749887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d9006487-8bad-4c84-9752-4a285e7995ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:17.766472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:17.857889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9006487-8bad-4c84-9752-4a285e7995ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:17.859276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9006487-8bad-4c84-9752-4a285e7995ac service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:17.893762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 668/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:20.093718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa4df-07af-4a8d-8924-80a08c8badbd None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.094192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa4df-07af-4a8d-8924-80a08c8badbd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.094323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa4df-07af-4a8d-8924-80a08c8badbd None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.095681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 661/1329] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:20.100948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41d8c-1982-4f69-8f7f-23c529b8d6c3 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.101403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41d8c-1982-4f69-8f7f-23c529b8d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.101501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41d8c-1982-4f69-8f7f-23c529b8d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.182183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-23c41d8c-1982-4f69-8f7f-23c529b8d6c3 None None] MFA Rules not processed for user `e585ef5ba4f347e99c8c23cbb6cb501a`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:20.183418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-23c41d8c-1982-4f69-8f7f-23c529b8d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:20.257600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:20.291751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 669/1330] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:20.574307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefa4df-07af-4a8d-8924-80a08c8badbd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:20.576434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-adefa4df-07af-4a8d-8924-80a08c8badbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:20.676903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefa4df-07af-4a8d-8924-80a08c8badbd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:20.699829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:20.753036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9c2ac-ce5d-4c6e-a00f-43da17986213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:20.753666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c2ac-ce5d-4c6e-a00f-43da17986213 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:20.753947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c2ac-ce5d-4c6e-a00f-43da17986213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:20.754215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c2ac-ce5d-4c6e-a00f-43da17986213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:20.755777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f5a9c2ac-ce5d-4c6e-a00f-43da17986213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:20.870154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9c2ac-ce5d-4c6e-a00f-43da17986213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:20.871617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9c2ac-ce5d-4c6e-a00f-43da17986213 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:20.890907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 662/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:23.470742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04021c-de03-4801-a296-40deced2f65d None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.471290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04021c-de03-4801-a296-40deced2f65d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.471290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04021c-de03-4801-a296-40deced2f65d None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.472649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 670/1332] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:23.477924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a3cc-09d2-4524-9306-341139785a6c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:23.478372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a3cc-09d2-4524-9306-341139785a6c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:23.478484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a3cc-09d2-4524-9306-341139785a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:23.541522 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:23.544256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6e51a3cc-09d2-4524-9306-341139785a6c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:23.546021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6e51a3cc-09d2-4524-9306-341139785a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:23.643082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 663/1333] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:26:23.925511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04021c-de03-4801-a296-40deced2f65d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:23.927104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ef04021c-de03-4801-a296-40deced2f65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:24.030403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04021c-de03-4801-a296-40deced2f65d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:24.101197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071c740-f8fc-4938-966a-15650b04e699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:24.101816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c740-f8fc-4938-966a-15650b04e699 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:24.102094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c740-f8fc-4938-966a-15650b04e699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:24.102363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c740-f8fc-4938-966a-15650b04e699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:24.103944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0071c740-f8fc-4938-966a-15650b04e699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:24.130063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:24.209903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071c740-f8fc-4938-966a-15650b04e699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:24.211278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071c740-f8fc-4938-966a-15650b04e699 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:24.228962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 671/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:26.165278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36844792-406a-4b5c-ba22-4b894b9218af None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:26.165858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36844792-406a-4b5c-ba22-4b894b9218af None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:26.165858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36844792-406a-4b5c-ba22-4b894b9218af None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:26.167207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 664/1335] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:26.172414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d5c7-9684-46fd-b251-a62ac131374c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:26.172818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d5c7-9684-46fd-b251-a62ac131374c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:26.172959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d5c7-9684-46fd-b251-a62ac131374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:26.236436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-49f6d5c7-9684-46fd-b251-a62ac131374c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:26.237540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-49f6d5c7-9684-46fd-b251-a62ac131374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:26.313204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:26.334979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 672/1336] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:26.623724 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36844792-406a-4b5c-ba22-4b894b9218af None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:26.625257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-36844792-406a-4b5c-ba22-4b894b9218af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:26.726559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36844792-406a-4b5c-ba22-4b894b9218af None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:26.754701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:26.799409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce5bb3-44fc-4811-9516-b0875cab4b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:26.800008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce5bb3-44fc-4811-9516-b0875cab4b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:26.800285 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce5bb3-44fc-4811-9516-b0875cab4b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:26.800551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce5bb3-44fc-4811-9516-b0875cab4b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:26.802148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a0ce5bb3-44fc-4811-9516-b0875cab4b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:26.912454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce5bb3-44fc-4811-9516-b0875cab4b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:26.914267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce5bb3-44fc-4811-9516-b0875cab4b93 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:26.932942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 665/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:29.566596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f8105-06f2-4495-8bfa-b257f95addfd None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:29.567151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f8105-06f2-4495-8bfa-b257f95addfd None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:29.567151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f8105-06f2-4495-8bfa-b257f95addfd None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:29.568512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 673/1338] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:29.573635 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831631-cdb8-4fd2-8ac8-674d1f457fdd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:29.577601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831631-cdb8-4fd2-8ac8-674d1f457fdd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:29.577601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2831631-cdb8-4fd2-8ac8-674d1f457fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:29.639149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d2831631-cdb8-4fd2-8ac8-674d1f457fdd None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:29.640267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d2831631-cdb8-4fd2-8ac8-674d1f457fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:29.648474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:29.736591 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 666/1339] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:30.015417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f8105-06f2-4495-8bfa-b257f95addfd None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:30.017038 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-184f8105-06f2-4495-8bfa-b257f95addfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:30.119297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f8105-06f2-4495-8bfa-b257f95addfd None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:30.190688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a88b62-5fe4-4773-83b5-9b3151e9a33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:30.191286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88b62-5fe4-4773-83b5-9b3151e9a33a service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:30.191565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88b62-5fe4-4773-83b5-9b3151e9a33a service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:30.191836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a88b62-5fe4-4773-83b5-9b3151e9a33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:30.193424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-76a88b62-5fe4-4773-83b5-9b3151e9a33a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:30.227639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:30.299361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a88b62-5fe4-4773-83b5-9b3151e9a33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:30.300807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a88b62-5fe4-4773-83b5-9b3151e9a33a service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:30.318781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 674/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:34.504516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eb71b-d89f-4def-b13c-dfc4f97558d2 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:34.505137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eb71b-d89f-4def-b13c-dfc4f97558d2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:34.505137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eb71b-d89f-4def-b13c-dfc4f97558d2 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:34.506375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 667/1341] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:34.511788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1fb1-8f7b-414c-8254-77938c8df9fc None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:34.512246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1fb1-8f7b-414c-8254-77938c8df9fc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:34.512362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1fb1-8f7b-414c-8254-77938c8df9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:34.578530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-57da1fb1-8f7b-414c-8254-77938c8df9fc None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:34.579755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-57da1fb1-8f7b-414c-8254-77938c8df9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:34.670585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:34.681554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 675/1342] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:34.967528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11eb71b-d89f-4def-b13c-dfc4f97558d2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:34.969107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c11eb71b-d89f-4def-b13c-dfc4f97558d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:35.072964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11eb71b-d89f-4def-b13c-dfc4f97558d2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:35.111017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:35.147239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3150d6-cdea-41d2-be8d-60e9103b0f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:35.147848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3150d6-cdea-41d2-be8d-60e9103b0f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:35.148128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3150d6-cdea-41d2-be8d-60e9103b0f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:35.148404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3150d6-cdea-41d2-be8d-60e9103b0f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:35.150023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5a3150d6-cdea-41d2-be8d-60e9103b0f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:35.259252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3150d6-cdea-41d2-be8d-60e9103b0f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:35.260633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3150d6-cdea-41d2-be8d-60e9103b0f8f service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:35.278662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 668/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:38.196767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6548f-8d0a-4725-96c8-fe1a91923031 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:38.197362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6548f-8d0a-4725-96c8-fe1a91923031 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:38.197362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6548f-8d0a-4725-96c8-fe1a91923031 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:38.198689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 676/1344] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:38.203863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994244e-fe90-406a-9610-896f83f72d29 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:38.204334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994244e-fe90-406a-9610-896f83f72d29 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:38.204449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994244e-fe90-406a-9610-896f83f72d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:38.270136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d994244e-fe90-406a-9610-896f83f72d29 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:38.271235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d994244e-fe90-406a-9610-896f83f72d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:38.289432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:38.369061 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 669/1345] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:38.652371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6548f-8d0a-4725-96c8-fe1a91923031 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:38.654061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-51f6548f-8d0a-4725-96c8-fe1a91923031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:38.878169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6548f-8d0a-4725-96c8-fe1a91923031 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:38.954802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61344564-0050-4731-a4f6-59088122daff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:38.955691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61344564-0050-4731-a4f6-59088122daff service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:38.956104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61344564-0050-4731-a4f6-59088122daff service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:38.956522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61344564-0050-4731-a4f6-59088122daff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:38.959038 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-61344564-0050-4731-a4f6-59088122daff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:39.004670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:39.072848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61344564-0050-4731-a4f6-59088122daff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:39.074332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61344564-0050-4731-a4f6-59088122daff service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:39.092376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 677/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:43.426485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851ff7-3545-47c5-a9de-2af238143d13 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:43.426976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851ff7-3545-47c5-a9de-2af238143d13 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:43.427058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851ff7-3545-47c5-a9de-2af238143d13 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:43.428397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 670/1347] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:43.434074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8546a5-a177-4f71-9c52-c61a61c320b3 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:43.434622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8546a5-a177-4f71-9c52-c61a61c320b3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:43.435246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8546a5-a177-4f71-9c52-c61a61c320b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:43.506279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-0c8546a5-a177-4f71-9c52-c61a61c320b3 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:43.507641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0c8546a5-a177-4f71-9c52-c61a61c320b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:43.612331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:43.614922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 678/1348] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:43.901023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a851ff7-3545-47c5-a9de-2af238143d13 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:43.902665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0a851ff7-3545-47c5-a9de-2af238143d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:44.012738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a851ff7-3545-47c5-a9de-2af238143d13 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:44.066513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:44.096547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ea56e-5268-4d31-9a17-54a302dadc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:44.097156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea56e-5268-4d31-9a17-54a302dadc5f service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:44.097434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea56e-5268-4d31-9a17-54a302dadc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:44.097751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea56e-5268-4d31-9a17-54a302dadc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:44.100040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dc9ea56e-5268-4d31-9a17-54a302dadc5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:44.209585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ea56e-5268-4d31-9a17-54a302dadc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:44.211074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ea56e-5268-4d31-9a17-54a302dadc5f service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:44.229742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 671/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:49.109301 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4f687-f7a6-4ce8-b1dc-4142e9ae0190 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:49.109860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4f687-f7a6-4ce8-b1dc-4142e9ae0190 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:49.109860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4f687-f7a6-4ce8-b1dc-4142e9ae0190 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:49.111550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 679/1350] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:49.116764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9c48-6b19-482f-8623-5274609ce9b1 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:49.117185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9c48-6b19-482f-8623-5274609ce9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:49.117375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9c48-6b19-482f-8623-5274609ce9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:49.220647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6d3b9c48-6b19-482f-8623-5274609ce9b1 None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:49.222347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6d3b9c48-6b19-482f-8623-5274609ce9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:49.244364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:49.392358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 672/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:53.512897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262fa38-a61c-4c2d-8236-442cc22a68f7 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:53.513471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262fa38-a61c-4c2d-8236-442cc22a68f7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:53.513983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262fa38-a61c-4c2d-8236-442cc22a68f7 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:53.515565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 680/1352] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:53.521051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcf81c-2e2f-4110-a7f6-e657f28fa038 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:53.521523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcf81c-2e2f-4110-a7f6-e657f28fa038 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:53.521795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcf81c-2e2f-4110-a7f6-e657f28fa038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:53.599700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-22fcf81c-2e2f-4110-a7f6-e657f28fa038 None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:53.600896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-22fcf81c-2e2f-4110-a7f6-e657f28fa038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:53.673818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:53.711180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 673/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:55.200754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bc179-c406-4ef1-8ced-0d6724979e6e None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:55.201343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bc179-c406-4ef1-8ced-0d6724979e6e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:55.201343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bc179-c406-4ef1-8ced-0d6724979e6e None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:55.202643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 681/1354] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:55.207475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a791-e608-4c49-91c4-e5f8577c7f22 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:55.207905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a791-e608-4c49-91c4-e5f8577c7f22 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:55.208146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a791-e608-4c49-91c4-e5f8577c7f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:55.287769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f797a791-e608-4c49-91c4-e5f8577c7f22 None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:55.288979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f797a791-e608-4c49-91c4-e5f8577c7f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:55.396629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 674/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:26:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:26:58.771501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c382-f20a-403c-a4f7-1eac618d0c5a None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:58.772059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c382-f20a-403c-a4f7-1eac618d0c5a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:58.772059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6c382-f20a-403c-a4f7-1eac618d0c5a None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:58.773374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 682/1356] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:58.778607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70a5a-bf66-4b2b-95a1-69fe1c95b603 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:58.779009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70a5a-bf66-4b2b-95a1-69fe1c95b603 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:58.779156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70a5a-bf66-4b2b-95a1-69fe1c95b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:58.813983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:58.847972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-57e70a5a-bf66-4b2b-95a1-69fe1c95b603 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:58.849355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-57e70a5a-bf66-4b2b-95a1-69fe1c95b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:58.980658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 675/1357] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:26:59.296079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e472d-9d52-4077-9f23-5c3761ea3c87 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:59.296868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e472d-9d52-4077-9f23-5c3761ea3c87 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:59.297348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e472d-9d52-4077-9f23-5c3761ea3c87 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:59.299182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 683/1358] 10.222.0.61 () {54 vars in 962 bytes} [Tue Aug 23 16:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:26:59.315053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626c88-efb9-43de-b129-0cae3788227b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:59.315712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626c88-efb9-43de-b129-0cae3788227b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:59.316275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3626c88-efb9-43de-b129-0cae3788227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:59.418445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d3626c88-efb9-43de-b129-0cae3788227b None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:59.419881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d3626c88-efb9-43de-b129-0cae3788227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:59.484702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:59.558786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 676/1359] 10.222.0.61 () {58 vars in 1059 bytes} [Tue Aug 23 16:26:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:59.567130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e472d-9d52-4077-9f23-5c3761ea3c87 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:59.568791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f12e472d-9d52-4077-9f23-5c3761ea3c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:59.722344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e472d-9d52-4077-9f23-5c3761ea3c87 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:59.798394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:59.843074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152cbef-514c-4066-839c-6014e97eae22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:59.843864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152cbef-514c-4066-839c-6014e97eae22 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:59.844249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152cbef-514c-4066-839c-6014e97eae22 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:59.844621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152cbef-514c-4066-839c-6014e97eae22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:59.846357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f152cbef-514c-4066-839c-6014e97eae22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:59.938498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152cbef-514c-4066-839c-6014e97eae22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:59.940431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152cbef-514c-4066-839c-6014e97eae22 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:59.962747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 684/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:02.078948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e906a-e9d7-4a45-b07d-abc311f79127 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:02.079462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e906a-e9d7-4a45-b07d-abc311f79127 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:02.079548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e906a-e9d7-4a45-b07d-abc311f79127 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:02.081131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 677/1361] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:02.086143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44472-31ac-4d1b-8117-c7054442caae None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:02.086570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44472-31ac-4d1b-8117-c7054442caae None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:02.086759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44472-31ac-4d1b-8117-c7054442caae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:02.175939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-33b44472-31ac-4d1b-8117-c7054442caae None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:02.175939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-33b44472-31ac-4d1b-8117-c7054442caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:02.214463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:02.285087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 685/1362] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:02.582624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e906a-e9d7-4a45-b07d-abc311f79127 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:02.584339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b37e906a-e9d7-4a45-b07d-abc311f79127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:02.780417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e906a-e9d7-4a45-b07d-abc311f79127 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:02.789992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:02.896463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb187290-f883-4f07-a0a3-74318b8f5a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:02.897268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb187290-f883-4f07-a0a3-74318b8f5a71 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:02.897683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb187290-f883-4f07-a0a3-74318b8f5a71 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:02.898070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb187290-f883-4f07-a0a3-74318b8f5a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:02.899792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fb187290-f883-4f07-a0a3-74318b8f5a71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:02.995760 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb187290-f883-4f07-a0a3-74318b8f5a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:02.997701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb187290-f883-4f07-a0a3-74318b8f5a71 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:03.017099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 678/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:05.403493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3340c-ee74-49e9-bbdd-c2f31eb90d1f None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:05.404473 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3340c-ee74-49e9-bbdd-c2f31eb90d1f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:05.404906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3340c-ee74-49e9-bbdd-c2f31eb90d1f None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:05.406451 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 686/1364] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:05.411903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4eb96-b919-47c5-9145-2c3962047611 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:05.412815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4eb96-b919-47c5-9145-2c3962047611 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:05.413250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4eb96-b919-47c5-9145-2c3962047611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:05.429672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:05.483818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d1f4eb96-b919-47c5-9145-2c3962047611 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:05.485329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d1f4eb96-b919-47c5-9145-2c3962047611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:05.593672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 679/1365] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:05.883808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eee19-1f53-46bf-b579-8d838e2a5aea None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:05.884209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eee19-1f53-46bf-b579-8d838e2a5aea None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:05.884829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eee19-1f53-46bf-b579-8d838e2a5aea None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:05.886953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 687/1366] 10.222.0.61 () {54 vars in 962 bytes} [Tue Aug 23 16:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:05.892311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31567ad1-45b8-4fd7-a87e-6e205317494a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:05.897052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31567ad1-45b8-4fd7-a87e-6e205317494a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:05.897052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31567ad1-45b8-4fd7-a87e-6e205317494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:05.972777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-31567ad1-45b8-4fd7-a87e-6e205317494a None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:05.974150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-31567ad1-45b8-4fd7-a87e-6e205317494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:06.012833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:06.104709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 680/1367] 10.222.0.61 () {58 vars in 1059 bytes} [Tue Aug 23 16:27:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:27:06.113165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eee19-1f53-46bf-b579-8d838e2a5aea None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:06.114772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-620eee19-1f53-46bf-b579-8d838e2a5aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:06.269380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eee19-1f53-46bf-b579-8d838e2a5aea None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:06.292103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:06.389241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf0e84-8abd-4bc6-b542-ec90c5d5dda7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:06.390314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0e84-8abd-4bc6-b542-ec90c5d5dda7 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:06.394238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0e84-8abd-4bc6-b542-ec90c5d5dda7 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:06.394238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf0e84-8abd-4bc6-b542-ec90c5d5dda7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:06.394238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f8cf0e84-8abd-4bc6-b542-ec90c5d5dda7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:06.483597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf0e84-8abd-4bc6-b542-ec90c5d5dda7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:06.485490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf0e84-8abd-4bc6-b542-ec90c5d5dda7 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:06.506624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 688/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:07.107367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3c93f-0215-468c-9fad-ff9eaa6662ec None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:07.107921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3c93f-0215-468c-9fad-ff9eaa6662ec None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:07.107921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3c93f-0215-468c-9fad-ff9eaa6662ec None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:07.109395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 681/1369] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:07.114476 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240ece-7cda-497b-971a-4797a310aa55 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:07.114763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240ece-7cda-497b-971a-4797a310aa55 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:07.115036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240ece-7cda-497b-971a-4797a310aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:07.149518 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:07.186486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b2240ece-7cda-497b-971a-4797a310aa55 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:07.187703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b2240ece-7cda-497b-971a-4797a310aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:07.291760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 689/1370] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:07.878438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420e0e-3aea-40cd-95d9-5935c89f0bf7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:07.878638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420e0e-3aea-40cd-95d9-5935c89f0bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:07.878891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83420e0e-3aea-40cd-95d9-5935c89f0bf7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:07.880365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 682/1371] 10.222.0.61 () {54 vars in 964 bytes} [Tue Aug 23 16:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:07.885116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a902d3-cac6-44e6-bd09-9dccd3a961b7 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:07.885673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a902d3-cac6-44e6-bd09-9dccd3a961b7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:07.885673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a902d3-cac6-44e6-bd09-9dccd3a961b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:07.964692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-29a902d3-cac6-44e6-bd09-9dccd3a961b7 None None] MFA Rules not processed for user `1a81f47e4b004716bf54175c55606d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:07.966321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-29a902d3-cac6-44e6-bd09-9dccd3a961b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:08.018606 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:08.049078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 690/1372] 10.222.0.61 () {58 vars in 1061 bytes} [Tue Aug 23 16:27:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:08.060023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420e0e-3aea-40cd-95d9-5935c89f0bf7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:08.061756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-83420e0e-3aea-40cd-95d9-5935c89f0bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:08.172668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83420e0e-3aea-40cd-95d9-5935c89f0bf7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:08.214280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:08.255058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a9a09-682b-469d-80e1-d4bf457de399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:08.255888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9a09-682b-469d-80e1-d4bf457de399 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:08.256457 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9a09-682b-469d-80e1-d4bf457de399 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:08.256907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9a09-682b-469d-80e1-d4bf457de399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:08.258714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d81a9a09-682b-469d-80e1-d4bf457de399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:08.377409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9a09-682b-469d-80e1-d4bf457de399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:08.377409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9a09-682b-469d-80e1-d4bf457de399 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:08.406173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 683/1373] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:08.664725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c57b0-2323-45d1-81da-80eb6735b55b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:08.665686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c57b0-2323-45d1-81da-80eb6735b55b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:08.665686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c57b0-2323-45d1-81da-80eb6735b55b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:08.667147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 691/1374] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:08.673344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a81e0-d652-4ad2-92e0-a41fd9dae2dc None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:08.673851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a81e0-d652-4ad2-92e0-a41fd9dae2dc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:08.674190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a81e0-d652-4ad2-92e0-a41fd9dae2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:08.750729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-653a81e0-d652-4ad2-92e0-a41fd9dae2dc None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:08.751955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-653a81e0-d652-4ad2-92e0-a41fd9dae2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:08.772399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:08.848295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 684/1375] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:09.141828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c57b0-2323-45d1-81da-80eb6735b55b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:09.143408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9b7c57b0-2323-45d1-81da-80eb6735b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:09.308273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c57b0-2323-45d1-81da-80eb6735b55b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:09.360860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:09.422887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84349c0-c9c2-4a82-a511-ff2702a8dcf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:09.423485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84349c0-c9c2-4a82-a511-ff2702a8dcf6 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:09.423761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84349c0-c9c2-4a82-a511-ff2702a8dcf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:09.424029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84349c0-c9c2-4a82-a511-ff2702a8dcf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:09.425637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f84349c0-c9c2-4a82-a511-ff2702a8dcf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:09.523620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84349c0-c9c2-4a82-a511-ff2702a8dcf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:09.525226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84349c0-c9c2-4a82-a511-ff2702a8dcf6 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:09.549977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 692/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:11.653881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a344bc-0ee7-4e3b-a90c-f086d3f57968 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:11.654407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a344bc-0ee7-4e3b-a90c-f086d3f57968 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:11.654407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a344bc-0ee7-4e3b-a90c-f086d3f57968 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:11.656091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 685/1377] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:11.661763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b646f3b-83c4-4642-bab8-5071c3339e87 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:11.662248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b646f3b-83c4-4642-bab8-5071c3339e87 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:11.662248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b646f3b-83c4-4642-bab8-5071c3339e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:11.729212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2b646f3b-83c4-4642-bab8-5071c3339e87 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:11.730347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2b646f3b-83c4-4642-bab8-5071c3339e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:11.737980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:11.839750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 693/1378] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:12.173358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a344bc-0ee7-4e3b-a90c-f086d3f57968 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:12.175240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b9a344bc-0ee7-4e3b-a90c-f086d3f57968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:12.335879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a344bc-0ee7-4e3b-a90c-f086d3f57968 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:12.339930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:12.458976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09502e8-1c6d-4f16-9bce-e2a14105ec3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:12.459600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09502e8-1c6d-4f16-9bce-e2a14105ec3a service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:12.459885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09502e8-1c6d-4f16-9bce-e2a14105ec3a service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:12.460178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09502e8-1c6d-4f16-9bce-e2a14105ec3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:12.461870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c09502e8-1c6d-4f16-9bce-e2a14105ec3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:12.558704 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09502e8-1c6d-4f16-9bce-e2a14105ec3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:12.560788 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09502e8-1c6d-4f16-9bce-e2a14105ec3a service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:12.580155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 686/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:14.673431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20c63-cedd-4dfa-b9bb-2ff4bb89a672 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:14.674055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20c63-cedd-4dfa-b9bb-2ff4bb89a672 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:14.674296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b20c63-cedd-4dfa-b9bb-2ff4bb89a672 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:14.676358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 694/1380] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:14.682043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95532e-70be-4fc3-9cf7-18650a4209fd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:14.682706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95532e-70be-4fc3-9cf7-18650a4209fd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:14.682706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95532e-70be-4fc3-9cf7-18650a4209fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:14.694388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:14.754741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-eb95532e-70be-4fc3-9cf7-18650a4209fd None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:14.755929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-eb95532e-70be-4fc3-9cf7-18650a4209fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:14.862597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 687/1381] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:15.164331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b20c63-cedd-4dfa-b9bb-2ff4bb89a672 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:15.165971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f7b20c63-cedd-4dfa-b9bb-2ff4bb89a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:15.319088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:15.329879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b20c63-cedd-4dfa-b9bb-2ff4bb89a672 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:15.449404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a6c7e-b26d-4582-88a3-dad83c48577b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:15.450616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6c7e-b26d-4582-88a3-dad83c48577b service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:15.450979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6c7e-b26d-4582-88a3-dad83c48577b service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:15.451155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6c7e-b26d-4582-88a3-dad83c48577b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:15.452761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bc1a6c7e-b26d-4582-88a3-dad83c48577b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:15.548904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a6c7e-b26d-4582-88a3-dad83c48577b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:15.550540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a6c7e-b26d-4582-88a3-dad83c48577b service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:15.561727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:15.570378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 695/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:18.101949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362e48-1bdd-4269-8c44-a7ae0818c82f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:18.102763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362e48-1bdd-4269-8c44-a7ae0818c82f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:18.102763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362e48-1bdd-4269-8c44-a7ae0818c82f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:18.104475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 688/1383] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:18.110786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75d32-0cad-4305-b391-bea45a78d67c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:18.111423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75d32-0cad-4305-b391-bea45a78d67c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:18.111423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d75d32-0cad-4305-b391-bea45a78d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:18.181468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e5d75d32-0cad-4305-b391-bea45a78d67c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:18.182736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e5d75d32-0cad-4305-b391-bea45a78d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:18.279959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 696/1384] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:18.568291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362e48-1bdd-4269-8c44-a7ae0818c82f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:18.570625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ba362e48-1bdd-4269-8c44-a7ae0818c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:18.668202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:18.733218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362e48-1bdd-4269-8c44-a7ae0818c82f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:18.851622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b8013-1d39-4537-ad8f-95dd8998fc51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:18.852236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8013-1d39-4537-ad8f-95dd8998fc51 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:18.852518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8013-1d39-4537-ad8f-95dd8998fc51 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:18.852791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8013-1d39-4537-ad8f-95dd8998fc51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:18.854440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e81b8013-1d39-4537-ad8f-95dd8998fc51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:18.909166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:18.952265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b8013-1d39-4537-ad8f-95dd8998fc51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:18.953998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b8013-1d39-4537-ad8f-95dd8998fc51 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:18.978600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 689/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:21.056001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ebbe-d65e-4582-bf88-49fcd9401585 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:21.056605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ebbe-d65e-4582-bf88-49fcd9401585 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:21.056605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478ebbe-d65e-4582-bf88-49fcd9401585 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:21.058228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 697/1386] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:21.064147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354acfa5-9d81-47b2-95ab-39b17ab2949a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:21.064609 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354acfa5-9d81-47b2-95ab-39b17ab2949a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:21.064912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354acfa5-9d81-47b2-95ab-39b17ab2949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:21.136561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-354acfa5-9d81-47b2-95ab-39b17ab2949a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:21.138557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-354acfa5-9d81-47b2-95ab-39b17ab2949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:21.252831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 690/1387] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:21.593764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478ebbe-d65e-4582-bf88-49fcd9401585 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:21.595371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e478ebbe-d65e-4582-bf88-49fcd9401585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:21.673526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:21.766918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478ebbe-d65e-4582-bf88-49fcd9401585 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:21.897544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550e46f-95ab-446c-a95e-a7a939ed4c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:21.898522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e46f-95ab-446c-a95e-a7a939ed4c65 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:21.898894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e46f-95ab-446c-a95e-a7a939ed4c65 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:21.899226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e46f-95ab-446c-a95e-a7a939ed4c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:21.901329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8550e46f-95ab-446c-a95e-a7a939ed4c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:21.945963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:21.999213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550e46f-95ab-446c-a95e-a7a939ed4c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:22.000838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550e46f-95ab-446c-a95e-a7a939ed4c65 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:22.020478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 698/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:23.842826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7331-8616-41e0-9a00-bbb0380a3aa5 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:23.843377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7331-8616-41e0-9a00-bbb0380a3aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:23.843377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7331-8616-41e0-9a00-bbb0380a3aa5 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:23.844700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 691/1389] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:23.850306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4bc1-5c84-4c4a-8f3f-fffd8f3798e4 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:23.850705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4bc1-5c84-4c4a-8f3f-fffd8f3798e4 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:23.850844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f4bc1-5c84-4c4a-8f3f-fffd8f3798e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:23.915565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-265f4bc1-5c84-4c4a-8f3f-fffd8f3798e4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:23.916763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-265f4bc1-5c84-4c4a-8f3f-fffd8f3798e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:24.015926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 699/1390] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:24.071326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee22c-bd8b-4bc9-a9a8-5b621fe96989 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:24.071602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee22c-bd8b-4bc9-a9a8-5b621fe96989 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:24.071877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee22c-bd8b-4bc9-a9a8-5b621fe96989 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:24.073229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 692/1391] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:24.079068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782b288-1683-42c9-96ac-daa6693fd24c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:24.079354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782b288-1683-42c9-96ac-daa6693fd24c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:24.079625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782b288-1683-42c9-96ac-daa6693fd24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:24.096058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:24.146053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b782b288-1683-42c9-96ac-daa6693fd24c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:24.147261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b782b288-1683-42c9-96ac-daa6693fd24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:24.242075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 700/1392] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:24.318592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240819db-3282-4f7a-8b68-61db6aeb53b4 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:24.318875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240819db-3282-4f7a-8b68-61db6aeb53b4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:24.319175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240819db-3282-4f7a-8b68-61db6aeb53b4 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:24.320536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 693/1393] 10.222.0.61 () {54 vars in 967 bytes} [Tue Aug 23 16:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:24.325977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d69f-d83a-4537-b665-308a3e520c33 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:24.326270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d69f-d83a-4537-b665-308a3e520c33 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:24.326545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d69f-d83a-4537-b665-308a3e520c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:24.403821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-48b7d69f-d83a-4537-b665-308a3e520c33 None None] MFA Rules not processed for user `f8070d1891844da59196d00ebbdff832`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:24.404945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-48b7d69f-d83a-4537-b665-308a3e520c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:24.439535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:24.482061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 701/1394] 10.222.0.61 () {58 vars in 1064 bytes} [Tue Aug 23 16:27:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:24.489805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240819db-3282-4f7a-8b68-61db6aeb53b4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:24.491304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-240819db-3282-4f7a-8b68-61db6aeb53b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:24.522870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:24.533389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7d69f-d83a-4537-b665-308a3e520c33 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:24.536759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-48b7d69f-d83a-4537-b665-308a3e520c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:24.598223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240819db-3282-4f7a-8b68-61db6aeb53b4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:24.655663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7d69f-d83a-4537-b665-308a3e520c33 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:24.674594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f3b0f-93a1-478c-8eb9-8c2e3de33a70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8070d1891844da59196d00ebbdff832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:24.675505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3b0f-93a1-478c-8eb9-8c2e3de33a70 service glance] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:24.675890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3b0f-93a1-478c-8eb9-8c2e3de33a70 service glance] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:24.676360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3b0f-93a1-478c-8eb9-8c2e3de33a70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:24.678569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c14f3b0f-93a1-478c-8eb9-8c2e3de33a70 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:24.721413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:24.758260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:24.773220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f041e-5b0a-4044-8112-47f53c20cc53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:24.773851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f041e-5b0a-4044-8112-47f53c20cc53 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:24.774125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f041e-5b0a-4044-8112-47f53c20cc53 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:24.774716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f041e-5b0a-4044-8112-47f53c20cc53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:24.776097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6d9f041e-5b0a-4044-8112-47f53c20cc53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:24.791743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f3b0f-93a1-478c-8eb9-8c2e3de33a70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:24.793289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f3b0f-93a1-478c-8eb9-8c2e3de33a70 service glance] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:24.811389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 694/1395] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:24.869499 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f041e-5b0a-4044-8112-47f53c20cc53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:24.871642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f041e-5b0a-4044-8112-47f53c20cc53 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:24.892667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 702/1396] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:27:25.800010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5970cb-f06b-4ca9-a9c0-f06e1a1bf567 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:25.800535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5970cb-f06b-4ca9-a9c0-f06e1a1bf567 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:25.800628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5970cb-f06b-4ca9-a9c0-f06e1a1bf567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:25.866950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4f5970cb-f06b-4ca9-a9c0-f06e1a1bf567 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:25.868176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4f5970cb-f06b-4ca9-a9c0-f06e1a1bf567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:25.953291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 695/1397] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:27:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:26.017582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91c7c4-b798-4879-b918-b2682f80e15f None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:26.018098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91c7c4-b798-4879-b918-b2682f80e15f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:26.018192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91c7c4-b798-4879-b918-b2682f80e15f None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:26.020028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 703/1398] 10.222.0.61 () {54 vars in 943 bytes} [Tue Aug 23 16:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:26.030576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5be731-f320-4b41-b892-ea489b873e5b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:26.030576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5be731-f320-4b41-b892-ea489b873e5b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:26.030576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5be731-f320-4b41-b892-ea489b873e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:26.093639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:26.112938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fc5be731-f320-4b41-b892-ea489b873e5b None None] MFA Rules not processed for user `8442dc046cb64619b62823b8bcc7cc4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:26.114350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fc5be731-f320-4b41-b892-ea489b873e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:26.233646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 696/1399] 10.222.0.61 () {58 vars in 1040 bytes} [Tue Aug 23 16:27:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:26.240966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91c7c4-b798-4879-b918-b2682f80e15f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:26.242545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9e91c7c4-b798-4879-b918-b2682f80e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:26.323030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:26.383783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91c7c4-b798-4879-b918-b2682f80e15f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:26.490359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01071d8-ef11-4bc2-83ae-e04c3339a5d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:26.490970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01071d8-ef11-4bc2-83ae-e04c3339a5d9 service swift] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:26.491253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01071d8-ef11-4bc2-83ae-e04c3339a5d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:26.491530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01071d8-ef11-4bc2-83ae-e04c3339a5d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:26.493205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c01071d8-ef11-4bc2-83ae-e04c3339a5d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:26.554243 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:26.576230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01071d8-ef11-4bc2-83ae-e04c3339a5d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:26.577790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01071d8-ef11-4bc2-83ae-e04c3339a5d9 service swift] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:26.586044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 704/1400] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:27:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 16:27:27.279906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5db6c-e667-43cd-9f66-cbe588862860 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:27.280452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5db6c-e667-43cd-9f66-cbe588862860 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:27.280452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5db6c-e667-43cd-9f66-cbe588862860 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:27.281994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 697/1401] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:27.287315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729efd55-aac7-472c-a900-77a4f45fbfdb None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:27.287807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729efd55-aac7-472c-a900-77a4f45fbfdb None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:27.287912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729efd55-aac7-472c-a900-77a4f45fbfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:27.360304 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-729efd55-aac7-472c-a900-77a4f45fbfdb None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:27.361712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-729efd55-aac7-472c-a900-77a4f45fbfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:27.479466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 705/1402] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:27.769661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5db6c-e667-43cd-9f66-cbe588862860 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:27.771185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a3c5db6c-e667-43cd-9f66-cbe588862860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:27.889141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:27.939075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5db6c-e667-43cd-9f66-cbe588862860 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:28.081948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e4dd-ba94-427b-9c26-17800f8b10ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:28.082844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e4dd-ba94-427b-9c26-17800f8b10ae service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:28.083304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e4dd-ba94-427b-9c26-17800f8b10ae service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:28.083580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e4dd-ba94-427b-9c26-17800f8b10ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:28.085197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7890e4dd-ba94-427b-9c26-17800f8b10ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:28.159003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:28.182325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890e4dd-ba94-427b-9c26-17800f8b10ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:28.184043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890e4dd-ba94-427b-9c26-17800f8b10ae service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:28.204695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 698/1403] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:30.348373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6ebfe-de01-41c3-aa9d-b24b32570c2f None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:30.348951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6ebfe-de01-41c3-aa9d-b24b32570c2f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:30.348951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6ebfe-de01-41c3-aa9d-b24b32570c2f None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:30.350605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 706/1404] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:30.356547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168038f5-0cbc-442b-8f31-3013bbd2ba27 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:30.356984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168038f5-0cbc-442b-8f31-3013bbd2ba27 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:30.357235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168038f5-0cbc-442b-8f31-3013bbd2ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:30.436052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-168038f5-0cbc-442b-8f31-3013bbd2ba27 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:30.436052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-168038f5-0cbc-442b-8f31-3013bbd2ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:30.569846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 699/1405] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:30.864707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6ebfe-de01-41c3-aa9d-b24b32570c2f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:30.866545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a4d6ebfe-de01-41c3-aa9d-b24b32570c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:30.932517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:31.037973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6ebfe-de01-41c3-aa9d-b24b32570c2f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:31.163090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1adc2e-5871-413b-ac73-87032176da25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:31.163820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1adc2e-5871-413b-ac73-87032176da25 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:31.164164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1adc2e-5871-413b-ac73-87032176da25 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:31.164566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1adc2e-5871-413b-ac73-87032176da25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:31.166259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dc1adc2e-5871-413b-ac73-87032176da25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:31.237708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:31.268183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1adc2e-5871-413b-ac73-87032176da25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:31.269823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1adc2e-5871-413b-ac73-87032176da25 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:31.288896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 707/1406] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:33.469649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034b356-b2b7-431f-80a5-12beee71956f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:33.470390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034b356-b2b7-431f-80a5-12beee71956f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:33.470390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034b356-b2b7-431f-80a5-12beee71956f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:33.471575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 700/1407] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:33.479835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f92b-3069-41af-a913-6184462a44c6 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:33.481099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f92b-3069-41af-a913-6184462a44c6 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:33.481099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117f92b-3069-41af-a913-6184462a44c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:33.562272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2117f92b-3069-41af-a913-6184462a44c6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:33.563661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2117f92b-3069-41af-a913-6184462a44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:33.667436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:33.678905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 708/1408] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:33.974595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034b356-b2b7-431f-80a5-12beee71956f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:33.976152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9034b356-b2b7-431f-80a5-12beee71956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:34.038407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:34.157860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034b356-b2b7-431f-80a5-12beee71956f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:34.304238 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30733c8-3a72-4024-bc61-34c78cefbc39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:34.304980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30733c8-3a72-4024-bc61-34c78cefbc39 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:34.305374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30733c8-3a72-4024-bc61-34c78cefbc39 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:34.305734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30733c8-3a72-4024-bc61-34c78cefbc39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:34.307573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b30733c8-3a72-4024-bc61-34c78cefbc39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:34.316199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:34.409451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30733c8-3a72-4024-bc61-34c78cefbc39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:34.411126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30733c8-3a72-4024-bc61-34c78cefbc39 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:34.431502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 701/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:43.728823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:44.429160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=42 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:50.318203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980fb7-8ed6-45dd-9177-0f4de7ef958c None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:50.318762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980fb7-8ed6-45dd-9177-0f4de7ef958c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:50.318762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980fb7-8ed6-45dd-9177-0f4de7ef958c None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:50.320027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 709/1410] 10.222.0.61 () {54 vars in 918 bytes} [Tue Aug 23 16:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:50.325198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d6bc-777f-4d08-8310-da018e910678 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:50.325639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d6bc-777f-4d08-8310-da018e910678 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:50.325790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d6bc-777f-4d08-8310-da018e910678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:50.400160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cda1d6bc-777f-4d08-8310-da018e910678 None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:50.401365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cda1d6bc-777f-4d08-8310-da018e910678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:50.505983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 702/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Tue Aug 23 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:50.520154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628389a-8076-4caa-ba78-a066257a6728 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:50.520487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628389a-8076-4caa-ba78-a066257a6728 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:50.520766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628389a-8076-4caa-ba78-a066257a6728 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:50.522143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 710/1412] 10.222.0.61 () {54 vars in 918 bytes} [Tue Aug 23 16:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:50.526840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa668-33ab-45ea-9643-787a189b7306 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:50.527129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa668-33ab-45ea-9643-787a189b7306 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:50.527404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa668-33ab-45ea-9643-787a189b7306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:50.599683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:50.602201 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a92fa668-33ab-45ea-9643-787a189b7306 None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:50.603382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a92fa668-33ab-45ea-9643-787a189b7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:50.716325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 703/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Tue Aug 23 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:27:53.080719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4c39-cc27-4828-a4f4-007513ac23b7 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:53.081195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4c39-cc27-4828-a4f4-007513ac23b7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:53.081304 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4c39-cc27-4828-a4f4-007513ac23b7 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:53.082620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:53.087776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d2ae2-61fc-4ba0-815f-cff42f63fe31 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:53.088172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d2ae2-61fc-4ba0-815f-cff42f63fe31 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:53.088323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d2ae2-61fc-4ba0-815f-cff42f63fe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:53.153471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d52d2ae2-61fc-4ba0-815f-cff42f63fe31 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:53.155280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d52d2ae2-61fc-4ba0-815f-cff42f63fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:53.208571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:53.249668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:53.538399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c4c39-cc27-4828-a4f4-007513ac23b7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:53.539952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f33c4c39-cc27-4828-a4f4-007513ac23b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:53.683320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c4c39-cc27-4828-a4f4-007513ac23b7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:53.754334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:53.795024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96dde-7804-4d90-a053-88e73daca9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:53.795560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96dde-7804-4d90-a053-88e73daca9d4 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:53.795839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96dde-7804-4d90-a053-88e73daca9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:53.796107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96dde-7804-4d90-a053-88e73daca9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:53.797726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2eb96dde-7804-4d90-a053-88e73daca9d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:53.883838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb96dde-7804-4d90-a053-88e73daca9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:53.885470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb96dde-7804-4d90-a053-88e73daca9d4 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:53.903583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 712/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:54.785488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5385f3c-5336-4562-919b-5e215faf8d3d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:54.786109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5385f3c-5336-4562-919b-5e215faf8d3d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:54.786109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5385f3c-5336-4562-919b-5e215faf8d3d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:54.787485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:54.793133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210690-1bcb-48d3-b0a3-4195cdab95d0 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:54.793585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210690-1bcb-48d3-b0a3-4195cdab95d0 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:54.794053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210690-1bcb-48d3-b0a3-4195cdab95d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:54.874528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-83210690-1bcb-48d3-b0a3-4195cdab95d0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:54.875734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-83210690-1bcb-48d3-b0a3-4195cdab95d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:54.901945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:54.969911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:55.121588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5385f3c-5336-4562-919b-5e215faf8d3d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:55.123166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e5385f3c-5336-4562-919b-5e215faf8d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:55.267525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5385f3c-5336-4562-919b-5e215faf8d3d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:55.308114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:55.380517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acde01c-8ef4-4aba-b499-3b86e27c95d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:55.381120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acde01c-8ef4-4aba-b499-3b86e27c95d5 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:55.381403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acde01c-8ef4-4aba-b499-3b86e27c95d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:55.381706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acde01c-8ef4-4aba-b499-3b86e27c95d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:55.383346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4acde01c-8ef4-4aba-b499-3b86e27c95d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:55.472916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acde01c-8ef4-4aba-b499-3b86e27c95d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:55.474572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acde01c-8ef4-4aba-b499-3b86e27c95d5 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:55.492179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 706/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:56.375550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad8cd-55b0-4e01-88c3-94ddce4c48a9 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:56.376101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad8cd-55b0-4e01-88c3-94ddce4c48a9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:56.376101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad8cd-55b0-4e01-88c3-94ddce4c48a9 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:56.377463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:56.382487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef0e5a-189f-484c-845e-6f70a54d23b9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:56.382923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef0e5a-189f-484c-845e-6f70a54d23b9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:56.383048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef0e5a-189f-484c-845e-6f70a54d23b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:56.437322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:56.458369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8aef0e5a-189f-484c-845e-6f70a54d23b9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:56.459574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8aef0e5a-189f-484c-845e-6f70a54d23b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:56.558109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:27:56.705747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fad8cd-55b0-4e01-88c3-94ddce4c48a9 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:56.707196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-18fad8cd-55b0-4e01-88c3-94ddce4c48a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:56.852978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fad8cd-55b0-4e01-88c3-94ddce4c48a9 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:56.865044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:56.964590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbfe5f-e191-4f81-886f-84613789a156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:56.965151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbfe5f-e191-4f81-886f-84613789a156 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:56.965437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbfe5f-e191-4f81-886f-84613789a156 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:56.965744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbfe5f-e191-4f81-886f-84613789a156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:56.967980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-78dbfe5f-e191-4f81-886f-84613789a156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:57.054797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbfe5f-e191-4f81-886f-84613789a156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:57.056433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbfe5f-e191-4f81-886f-84613789a156 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:57.075264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 715/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:57.935046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a4898-5644-46b7-b7d3-1f498154b8a9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:57.935656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a4898-5644-46b7-b7d3-1f498154b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:57.935656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a4898-5644-46b7-b7d3-1f498154b8a9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:57.936975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:57.941981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c8a3-0949-4624-980e-73feef4f889b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:57.942400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c8a3-0949-4624-980e-73feef4f889b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:57.942530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c8a3-0949-4624-980e-73feef4f889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:57.962413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:58.019424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8692c8a3-0949-4624-980e-73feef4f889b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:58.020630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8692c8a3-0949-4624-980e-73feef4f889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:58.117907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:27:58.275547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a4898-5644-46b7-b7d3-1f498154b8a9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:58.276976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f56a4898-5644-46b7-b7d3-1f498154b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:58.384205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:58.421237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a4898-5644-46b7-b7d3-1f498154b8a9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:58.534778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c562069-0ea9-4d89-be32-83786c6a1330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:58.535286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562069-0ea9-4d89-be32-83786c6a1330 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:58.535561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562069-0ea9-4d89-be32-83786c6a1330 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:58.535832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c562069-0ea9-4d89-be32-83786c6a1330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:58.537421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c562069-0ea9-4d89-be32-83786c6a1330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:58.610817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:58.624537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c562069-0ea9-4d89-be32-83786c6a1330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:58.628514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c562069-0ea9-4d89-be32-83786c6a1330 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:58.644029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 709/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:27:59.499668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cccb-ac46-4133-9522-299f79c7477f None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:59.500334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cccb-ac46-4133-9522-299f79c7477f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:59.500334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172cccb-ac46-4133-9522-299f79c7477f None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:59.501767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:27:59.506905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474eab-bf03-4171-8e28-e5d1c936a9e0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:59.507359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474eab-bf03-4171-8e28-e5d1c936a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:59.507601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98474eab-bf03-4171-8e28-e5d1c936a9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:59.581396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-98474eab-bf03-4171-8e28-e5d1c936a9e0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:59.582619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-98474eab-bf03-4171-8e28-e5d1c936a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:59.677985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:59.829735 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172cccb-ac46-4133-9522-299f79c7477f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:59.831284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4172cccb-ac46-4133-9522-299f79c7477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:59.916633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:59.977418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172cccb-ac46-4133-9522-299f79c7477f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:00.089462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741f1aa-2ffb-4635-8321-127c67bc379b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:00.090097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f1aa-2ffb-4635-8321-127c67bc379b service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:00.090378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f1aa-2ffb-4635-8321-127c67bc379b service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:00.090654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f1aa-2ffb-4635-8321-127c67bc379b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:00.092794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6741f1aa-2ffb-4635-8321-127c67bc379b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:00.140472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:00.186793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741f1aa-2ffb-4635-8321-127c67bc379b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:00.189357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741f1aa-2ffb-4635-8321-127c67bc379b service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:00.209634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 718/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:01.077558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ce08-18de-4cb8-a385-50865b0e5987 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:01.078069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ce08-18de-4cb8-a385-50865b0e5987 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:01.078177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2ce08-18de-4cb8-a385-50865b0e5987 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:01.079612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:01.084643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a8a12-4077-4188-964d-947c5a8af852 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:01.085068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a8a12-4077-4188-964d-947c5a8af852 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:01.085208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a8a12-4077-4188-964d-947c5a8af852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:01.160873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-eb5a8a12-4077-4188-964d-947c5a8af852 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:01.162141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-eb5a8a12-4077-4188-964d-947c5a8af852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:01.258443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:01.408830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2ce08-18de-4cb8-a385-50865b0e5987 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:01.410389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-23b2ce08-18de-4cb8-a385-50865b0e5987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:01.459207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:01.555810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2ce08-18de-4cb8-a385-50865b0e5987 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:01.665947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31d6af-82ae-47ff-a7db-a4d17e69359e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:01.666474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31d6af-82ae-47ff-a7db-a4d17e69359e service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:01.666751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31d6af-82ae-47ff-a7db-a4d17e69359e service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:01.667019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31d6af-82ae-47ff-a7db-a4d17e69359e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:01.668601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0c31d6af-82ae-47ff-a7db-a4d17e69359e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:01.675958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:01.756482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31d6af-82ae-47ff-a7db-a4d17e69359e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:01.758132 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31d6af-82ae-47ff-a7db-a4d17e69359e service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:01.776389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 712/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:02.641525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a276-7510-46ca-bf9c-9aa390d047fd None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:02.642100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a276-7510-46ca-bf9c-9aa390d047fd None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:02.642100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2a276-7510-46ca-bf9c-9aa390d047fd None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:02.643346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:02.648244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f517-f5ce-4af3-96ab-d76b42fee18f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:02.648676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f517-f5ce-4af3-96ab-d76b42fee18f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:02.648802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671f517-f5ce-4af3-96ab-d76b42fee18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:02.723159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b671f517-f5ce-4af3-96ab-d76b42fee18f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:02.724373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b671f517-f5ce-4af3-96ab-d76b42fee18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:02.791416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:02.820867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:02.970457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2a276-7510-46ca-bf9c-9aa390d047fd None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:02.971900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e8d2a276-7510-46ca-bf9c-9aa390d047fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:02.989597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:03.115729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2a276-7510-46ca-bf9c-9aa390d047fd None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:03.200489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:03.226619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705303a7-8c9d-4e5d-abce-7dfe77513d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:03.227160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705303a7-8c9d-4e5d-abce-7dfe77513d97 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:03.227442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705303a7-8c9d-4e5d-abce-7dfe77513d97 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:03.227718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705303a7-8c9d-4e5d-abce-7dfe77513d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:03.229320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-705303a7-8c9d-4e5d-abce-7dfe77513d97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:03.315511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705303a7-8c9d-4e5d-abce-7dfe77513d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:03.317111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705303a7-8c9d-4e5d-abce-7dfe77513d97 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:03.335237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 721/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:04.206309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fdfe3-4d8d-4492-b6bc-55c2265d9e6f None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:04.206854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fdfe3-4d8d-4492-b6bc-55c2265d9e6f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:04.206854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fdfe3-4d8d-4492-b6bc-55c2265d9e6f None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:04.208189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:04.212992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e7c7b-f485-47f8-9703-9a293eaba3f0 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:04.213439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e7c7b-f485-47f8-9703-9a293eaba3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:04.213557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e7c7b-f485-47f8-9703-9a293eaba3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:04.290306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e94e7c7b-f485-47f8-9703-9a293eaba3f0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:04.291436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e94e7c7b-f485-47f8-9703-9a293eaba3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:04.331898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:04.386443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:04.538282 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fdfe3-4d8d-4492-b6bc-55c2265d9e6f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:04.539810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-438fdfe3-4d8d-4492-b6bc-55c2265d9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:04.682793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fdfe3-4d8d-4492-b6bc-55c2265d9e6f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:04.737068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:04.795919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275d901-ae9d-4972-867e-df9035bda6b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:04.796521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d901-ae9d-4972-867e-df9035bda6b5 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:04.796802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d901-ae9d-4972-867e-df9035bda6b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:04.797072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275d901-ae9d-4972-867e-df9035bda6b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:04.798705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5275d901-ae9d-4972-867e-df9035bda6b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:04.885803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275d901-ae9d-4972-867e-df9035bda6b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:04.887401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275d901-ae9d-4972-867e-df9035bda6b5 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:04.906022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 715/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:05.760840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3622-6e91-49b1-9c76-c27c7e6af14c None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:05.761433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3622-6e91-49b1-9c76-c27c7e6af14c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:05.761433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3622-6e91-49b1-9c76-c27c7e6af14c None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:05.762791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:05.767904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c90d3-57c9-40f5-9996-b8a0d33e8c78 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:05.768343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c90d3-57c9-40f5-9996-b8a0d33e8c78 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:05.768463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c90d3-57c9-40f5-9996-b8a0d33e8c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:05.844025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1c8c90d3-57c9-40f5-9996-b8a0d33e8c78 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:05.845224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c8c90d3-57c9-40f5-9996-b8a0d33e8c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:05.847242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:05.940801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:06.089258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3622-6e91-49b1-9c76-c27c7e6af14c None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:06.090809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fbab3622-6e91-49b1-9c76-c27c7e6af14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:06.236514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3622-6e91-49b1-9c76-c27c7e6af14c None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:06.263183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:06.348010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cdbdb-eeb5-4e8f-b013-655c044f9be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:06.348613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cdbdb-eeb5-4e8f-b013-655c044f9be6 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:06.348894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cdbdb-eeb5-4e8f-b013-655c044f9be6 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:06.349166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cdbdb-eeb5-4e8f-b013-655c044f9be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:06.350801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c99cdbdb-eeb5-4e8f-b013-655c044f9be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:06.440005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cdbdb-eeb5-4e8f-b013-655c044f9be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:06.441604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cdbdb-eeb5-4e8f-b013-655c044f9be6 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:06.459643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 724/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:08.268025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809eaca-ca97-4410-a7b2-5437dbd9d0fc None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:08.268650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809eaca-ca97-4410-a7b2-5437dbd9d0fc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:08.268650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809eaca-ca97-4410-a7b2-5437dbd9d0fc None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:08.269958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:08.275208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264dab-cd95-4be7-b555-1221310fdb05 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:08.275685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264dab-cd95-4be7-b555-1221310fdb05 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:08.275798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc264dab-cd95-4be7-b555-1221310fdb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:08.317035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:08.342104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-fc264dab-cd95-4be7-b555-1221310fdb05 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:08.343854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fc264dab-cd95-4be7-b555-1221310fdb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:08.439062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:28:08.720792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809eaca-ca97-4410-a7b2-5437dbd9d0fc None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:08.722366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7809eaca-ca97-4410-a7b2-5437dbd9d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:08.823805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809eaca-ca97-4410-a7b2-5437dbd9d0fc None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:08.855114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:08.898401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf09b-e8dc-4b69-9b63-9be926120509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:08.898995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf09b-e8dc-4b69-9b63-9be926120509 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:08.899271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf09b-e8dc-4b69-9b63-9be926120509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:08.899541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf09b-e8dc-4b69-9b63-9be926120509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:08.901145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8becf09b-e8dc-4b69-9b63-9be926120509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:09.005664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf09b-e8dc-4b69-9b63-9be926120509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:09.007095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf09b-e8dc-4b69-9b63-9be926120509 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:09.025446 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 718/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:11.134696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274b57-ea6f-4bc5-b7d0-6161aaea1ab3 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:11.135235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274b57-ea6f-4bc5-b7d0-6161aaea1ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:11.135235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274b57-ea6f-4bc5-b7d0-6161aaea1ab3 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:11.136593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:11.142370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7b47-1629-47db-be7b-c90f1a18552d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:11.142783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7b47-1629-47db-be7b-c90f1a18552d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:11.142924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c7b47-1629-47db-be7b-c90f1a18552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:11.207609 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-547c7b47-1629-47db-be7b-c90f1a18552d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:11.208802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-547c7b47-1629-47db-be7b-c90f1a18552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:11.221455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:11.304737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:11.587226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0274b57-ea6f-4bc5-b7d0-6161aaea1ab3 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:11.588820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b0274b57-ea6f-4bc5-b7d0-6161aaea1ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:11.690885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0274b57-ea6f-4bc5-b7d0-6161aaea1ab3 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:11.703221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:11.764794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738e188-c621-4132-9339-737138c57550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:11.765399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e188-c621-4132-9339-737138c57550 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:11.765715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e188-c621-4132-9339-737138c57550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:11.765988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e188-c621-4132-9339-737138c57550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:11.767579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b738e188-c621-4132-9339-737138c57550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:11.874536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738e188-c621-4132-9339-737138c57550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:11.875936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738e188-c621-4132-9339-737138c57550 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:11.894143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 727/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:14.199112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd4f21-bda7-4d8d-9358-4fe951121a0d None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:14.199658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd4f21-bda7-4d8d-9358-4fe951121a0d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:14.199658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd4f21-bda7-4d8d-9358-4fe951121a0d None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:14.201013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:14.207005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b69487-375a-4c18-8ab6-26b1c7c30f14 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:14.207442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b69487-375a-4c18-8ab6-26b1c7c30f14 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:14.207540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b69487-375a-4c18-8ab6-26b1c7c30f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:14.255532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:14.274500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-40b69487-375a-4c18-8ab6-26b1c7c30f14 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:14.275754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-40b69487-375a-4c18-8ab6-26b1c7c30f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:14.377197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:14.661316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd4f21-bda7-4d8d-9358-4fe951121a0d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:14.662898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cbcd4f21-bda7-4d8d-9358-4fe951121a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:14.766962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd4f21-bda7-4d8d-9358-4fe951121a0d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:14.807012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:14.839317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a03e82-2f77-483f-a26a-131c6ab09186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:14.839924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03e82-2f77-483f-a26a-131c6ab09186 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:14.840208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03e82-2f77-483f-a26a-131c6ab09186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:14.840486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a03e82-2f77-483f-a26a-131c6ab09186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:14.842611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-11a03e82-2f77-483f-a26a-131c6ab09186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:14.949954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a03e82-2f77-483f-a26a-131c6ab09186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:14.951297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a03e82-2f77-483f-a26a-131c6ab09186 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:14.970110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 721/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:17.002414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d27a9-d614-4816-a02c-abe7a8977556 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:17.002996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d27a9-d614-4816-a02c-abe7a8977556 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:17.002996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d27a9-d614-4816-a02c-abe7a8977556 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:17.004300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:17.009713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c349-8162-457f-a5d8-b79def7fca38 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:17.010115 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c349-8162-457f-a5d8-b79def7fca38 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:17.010260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53c349-8162-457f-a5d8-b79def7fca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:17.076425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9e53c349-8162-457f-a5d8-b79def7fca38 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:17.078203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9e53c349-8162-457f-a5d8-b79def7fca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:17.098253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:17.172955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:17.456486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d27a9-d614-4816-a02c-abe7a8977556 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:17.458125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-658d27a9-d614-4816-a02c-abe7a8977556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:17.559900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d27a9-d614-4816-a02c-abe7a8977556 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:17.579958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:17.633871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2c12-9133-4e4a-981b-3691986363b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:17.634471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2c12-9133-4e4a-981b-3691986363b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:17.634749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2c12-9133-4e4a-981b-3691986363b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:17.635018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2c12-9133-4e4a-981b-3691986363b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:17.636620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dbeb2c12-9133-4e4a-981b-3691986363b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:17.741481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2c12-9133-4e4a-981b-3691986363b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:17.742875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2c12-9133-4e4a-981b-3691986363b0 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:17.761571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 730/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:19.727459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6180c-9297-40ba-82db-85588a595ec5 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:19.728038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6180c-9297-40ba-82db-85588a595ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:19.728038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6180c-9297-40ba-82db-85588a595ec5 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:19.729377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:19.734836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288fefc-d639-4dec-932a-53ade1afc169 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:19.735259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288fefc-d639-4dec-932a-53ade1afc169 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:19.735418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288fefc-d639-4dec-932a-53ade1afc169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:19.798460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:19.801257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b288fefc-d639-4dec-932a-53ade1afc169 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:19.802481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b288fefc-d639-4dec-932a-53ade1afc169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:19.898553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:20.183687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6180c-9297-40ba-82db-85588a595ec5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:20.185226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-93a6180c-9297-40ba-82db-85588a595ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:20.286002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6180c-9297-40ba-82db-85588a595ec5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:20.334265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:20.357964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcd2bd-8e9e-45e0-9152-262cfbc8bf72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:20.358570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd2bd-8e9e-45e0-9152-262cfbc8bf72 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:20.358848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd2bd-8e9e-45e0-9152-262cfbc8bf72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:20.359119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd2bd-8e9e-45e0-9152-262cfbc8bf72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:20.360691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7dfcd2bd-8e9e-45e0-9152-262cfbc8bf72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:20.470728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcd2bd-8e9e-45e0-9152-262cfbc8bf72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:20.472166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcd2bd-8e9e-45e0-9152-262cfbc8bf72 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:20.490743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 724/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:22.428435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069286-1744-404d-95f0-fec89eb9b608 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:22.429020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069286-1744-404d-95f0-fec89eb9b608 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:22.429020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069286-1744-404d-95f0-fec89eb9b608 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:22.430407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:22.435936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7163f-4d0f-43d2-943f-1a3a2306dbcf None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:22.436330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7163f-4d0f-43d2-943f-1a3a2306dbcf None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:22.436488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7163f-4d0f-43d2-943f-1a3a2306dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:22.503405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-71b7163f-4d0f-43d2-943f-1a3a2306dbcf None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:22.504613 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-71b7163f-4d0f-43d2-943f-1a3a2306dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:22.533682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:22.599771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:22.884103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74069286-1744-404d-95f0-fec89eb9b608 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:22.885716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-74069286-1744-404d-95f0-fec89eb9b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:22.986986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74069286-1744-404d-95f0-fec89eb9b608 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:23.014985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:23.060592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1efb5-60f1-41e8-8db4-32618d1bf558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:23.061754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1efb5-60f1-41e8-8db4-32618d1bf558 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:23.062038 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1efb5-60f1-41e8-8db4-32618d1bf558 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:23.062314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1efb5-60f1-41e8-8db4-32618d1bf558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:23.063914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dba1efb5-60f1-41e8-8db4-32618d1bf558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:23.169431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1efb5-60f1-41e8-8db4-32618d1bf558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:23.170856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1efb5-60f1-41e8-8db4-32618d1bf558 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:23.189281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 733/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:25.123739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b53a3-b42e-4d26-821c-d18ae0cf5742 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:25.124270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b53a3-b42e-4d26-821c-d18ae0cf5742 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:25.124270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b53a3-b42e-4d26-821c-d18ae0cf5742 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:25.125650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:25.131863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b292-fb99-427b-be9e-ad301db8b6bc None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:25.132288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b292-fb99-427b-be9e-ad301db8b6bc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:25.132444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954b292-fb99-427b-be9e-ad301db8b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:25.197124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-c954b292-fb99-427b-be9e-ad301db8b6bc None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:25.198369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c954b292-fb99-427b-be9e-ad301db8b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:25.206655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:25.296256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:25.575515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b53a3-b42e-4d26-821c-d18ae0cf5742 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:25.577109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4b9b53a3-b42e-4d26-821c-d18ae0cf5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:25.692184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b53a3-b42e-4d26-821c-d18ae0cf5742 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:25.748302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:25.766844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d83682-cfdd-4d52-96c6-bc5a37cb80ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:25.767453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83682-cfdd-4d52-96c6-bc5a37cb80ac service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:25.767727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83682-cfdd-4d52-96c6-bc5a37cb80ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:25.767996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d83682-cfdd-4d52-96c6-bc5a37cb80ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:25.769582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9d83682-cfdd-4d52-96c6-bc5a37cb80ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:25.876889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d83682-cfdd-4d52-96c6-bc5a37cb80ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:25.878367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d83682-cfdd-4d52-96c6-bc5a37cb80ac service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:25.897696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 727/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:27.875018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf3d7d-4d40-423a-b903-540fa00ec285 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:27.875572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf3d7d-4d40-423a-b903-540fa00ec285 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:27.875698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf3d7d-4d40-423a-b903-540fa00ec285 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:27.876959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:27.882346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5803f-dd51-4fa6-ac08-c66f9cefe47c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:27.882814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5803f-dd51-4fa6-ac08-c66f9cefe47c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:27.882925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5803f-dd51-4fa6-ac08-c66f9cefe47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.065215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-89a5803f-dd51-4fa6-ac08-c66f9cefe47c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:28.066477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-89a5803f-dd51-4fa6-ac08-c66f9cefe47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:28.103884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:28.161908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:28.452353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf3d7d-4d40-423a-b903-540fa00ec285 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:28.454000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0aaf3d7d-4d40-423a-b903-540fa00ec285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:28.558043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf3d7d-4d40-423a-b903-540fa00ec285 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:28.594831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:28.629947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99621a77-10a2-4706-8541-7403b0fe95d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:28.630543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621a77-10a2-4706-8541-7403b0fe95d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:28.630819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621a77-10a2-4706-8541-7403b0fe95d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:28.631088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621a77-10a2-4706-8541-7403b0fe95d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:28.632665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-99621a77-10a2-4706-8541-7403b0fe95d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:28.737213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621a77-10a2-4706-8541-7403b0fe95d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:28.738610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621a77-10a2-4706-8541-7403b0fe95d2 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:28.756783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 736/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:30.673401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0eda-ed43-47c2-877b-6ee647f5dbb0 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:30.674005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0eda-ed43-47c2-877b-6ee647f5dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:30.674005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0eda-ed43-47c2-877b-6ee647f5dbb0 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:30.675308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:30.680657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511397-67e2-4501-873b-e7a005b54ebd None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:30.681095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511397-67e2-4501-873b-e7a005b54ebd None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:30.681191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac511397-67e2-4501-873b-e7a005b54ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:30.750322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ac511397-67e2-4501-873b-e7a005b54ebd None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:30.751489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ac511397-67e2-4501-873b-e7a005b54ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:30.775848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:30.852895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:31.136910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f0eda-ed43-47c2-877b-6ee647f5dbb0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:31.138474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-780f0eda-ed43-47c2-877b-6ee647f5dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:31.238774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f0eda-ed43-47c2-877b-6ee647f5dbb0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:31.304001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:31.310630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19227346-8145-4ed8-ae25-cd0b12929a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:31.311202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227346-8145-4ed8-ae25-cd0b12929a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:31.311482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227346-8145-4ed8-ae25-cd0b12929a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:31.311750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19227346-8145-4ed8-ae25-cd0b12929a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:31.313332 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-19227346-8145-4ed8-ae25-cd0b12929a46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:31.421427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19227346-8145-4ed8-ae25-cd0b12929a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:31.422919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19227346-8145-4ed8-ae25-cd0b12929a46 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:31.441791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 730/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:33.343697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e108-e29c-4c9a-9f9e-3ede524fb92b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.344224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e108-e29c-4c9a-9f9e-3ede524fb92b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.344224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575e108-e29c-4c9a-9f9e-3ede524fb92b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.345622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:33.350854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ab1f4-6fbc-47ab-a9dc-6d853b9a14ce None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.351275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ab1f4-6fbc-47ab-a9dc-6d853b9a14ce None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.351443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ab1f4-6fbc-47ab-a9dc-6d853b9a14ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.417801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-903ab1f4-6fbc-47ab-a9dc-6d853b9a14ce None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:33.419013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-903ab1f4-6fbc-47ab-a9dc-6d853b9a14ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:33.466273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:33.514530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:33.794374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575e108-e29c-4c9a-9f9e-3ede524fb92b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:33.795989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6575e108-e29c-4c9a-9f9e-3ede524fb92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:33.898416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575e108-e29c-4c9a-9f9e-3ede524fb92b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:33.944967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:33.970363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71401ff-70e4-4c42-b731-cce65c949457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:33.970971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71401ff-70e4-4c42-b731-cce65c949457 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:33.971250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71401ff-70e4-4c42-b731-cce65c949457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:33.971522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71401ff-70e4-4c42-b731-cce65c949457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:33.973116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a71401ff-70e4-4c42-b731-cce65c949457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:34.080956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71401ff-70e4-4c42-b731-cce65c949457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:34.082445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71401ff-70e4-4c42-b731-cce65c949457 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:34.100444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 739/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:43.512203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=22 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:44.098204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=66 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:53.536374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd409f6-b1bf-40d8-b7d3-e4706ae5d4b1 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:53.536957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd409f6-b1bf-40d8-b7d3-e4706ae5d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:53.536957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd409f6-b1bf-40d8-b7d3-e4706ae5d4b1 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:53.538361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 732/1471] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:53.543496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d7171-b800-448e-a264-36fb834f8673 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:53.543927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d7171-b800-448e-a264-36fb834f8673 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:53.544036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d7171-b800-448e-a264-36fb834f8673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:53.609021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8c9d7171-b800-448e-a264-36fb834f8673 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:53.610613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8c9d7171-b800-448e-a264-36fb834f8673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:53.705790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 740/1472] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:54.001169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cde8c-d54c-4a92-9423-be7f5c26c150 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:54.001454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cde8c-d54c-4a92-9423-be7f5c26c150 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:54.001766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cde8c-d54c-4a92-9423-be7f5c26c150 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:54.003086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 733/1473] 10.222.0.61 () {54 vars in 967 bytes} [Tue Aug 23 16:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:54.008094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553f38-921d-4f73-b653-c08ca0054c8f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:54.008387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553f38-921d-4f73-b653-c08ca0054c8f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:54.008665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28553f38-921d-4f73-b653-c08ca0054c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:54.086140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-28553f38-921d-4f73-b653-c08ca0054c8f None None] MFA Rules not processed for user `f8070d1891844da59196d00ebbdff832`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:54.087359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-28553f38-921d-4f73-b653-c08ca0054c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:54.107512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:54.163439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 741/1474] 10.222.0.61 () {58 vars in 1064 bytes} [Tue Aug 23 16:28:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:54.171493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cde8c-d54c-4a92-9423-be7f5c26c150 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:54.173023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f14cde8c-d54c-4a92-9423-be7f5c26c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:54.274942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cde8c-d54c-4a92-9423-be7f5c26c150 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:54.348774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bffc17-7389-4c08-8ab6-4b6bb61894b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8070d1891844da59196d00ebbdff832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:54.349368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bffc17-7389-4c08-8ab6-4b6bb61894b8 service glance] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:54.349669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bffc17-7389-4c08-8ab6-4b6bb61894b8 service glance] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:54.349942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bffc17-7389-4c08-8ab6-4b6bb61894b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:54.351518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-32bffc17-7389-4c08-8ab6-4b6bb61894b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:54.403993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:54.458109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bffc17-7389-4c08-8ab6-4b6bb61894b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:54.459549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bffc17-7389-4c08-8ab6-4b6bb61894b8 service glance] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:54.477814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 734/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:56.460831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dad1e6-e859-4da0-a47a-042ce9885b26 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:56.461412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dad1e6-e859-4da0-a47a-042ce9885b26 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:56.461412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dad1e6-e859-4da0-a47a-042ce9885b26 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:56.462811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 742/1476] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:56.468189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daecee0-a628-4bdd-9b38-e1cc72e1cfb0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:56.468644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daecee0-a628-4bdd-9b38-e1cc72e1cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:56.468774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daecee0-a628-4bdd-9b38-e1cc72e1cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:56.534615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1daecee0-a628-4bdd-9b38-e1cc72e1cfb0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:56.535828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1daecee0-a628-4bdd-9b38-e1cc72e1cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:56.630557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 735/1477] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:28:56.902184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dad1e6-e859-4da0-a47a-042ce9885b26 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:56.903732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-59dad1e6-e859-4da0-a47a-042ce9885b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:57.024719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dad1e6-e859-4da0-a47a-042ce9885b26 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:57.073526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:57.120694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8bfa-ffed-4b1e-b0d2-c67e8e4457e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:57.121286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8bfa-ffed-4b1e-b0d2-c67e8e4457e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:57.121562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8bfa-ffed-4b1e-b0d2-c67e8e4457e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:57.121891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8bfa-ffed-4b1e-b0d2-c67e8e4457e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:57.122494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8bfa-ffed-4b1e-b0d2-c67e8e4457e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:57.124545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING py.warnings [None req-b50b8bfa-ffed-4b1e-b0d2-c67e8e4457e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:28:57.124545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: warnings.warn(msg) Aug 23 16:28:57.124545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: Aug 23 16:28:57.125697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8bfa-ffed-4b1e-b0d2-c67e8e4457e5 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:57.145073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 743/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Tue Aug 23 16:28:56 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:28:59.056480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262800ee-4900-4de8-8235-1cccd8e7f0c5 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:59.057015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262800ee-4900-4de8-8235-1cccd8e7f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:59.057129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262800ee-4900-4de8-8235-1cccd8e7f0c5 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:59.058878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 736/1479] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:28:59.064508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093fce4-9ad1-493b-9e6d-0d5d52317d4a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:59.064923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093fce4-9ad1-493b-9e6d-0d5d52317d4a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:59.065135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093fce4-9ad1-493b-9e6d-0d5d52317d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:59.130289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d093fce4-9ad1-493b-9e6d-0d5d52317d4a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:28:59.131503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d093fce4-9ad1-493b-9e6d-0d5d52317d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:59.226256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 744/1480] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:28:59.517234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262800ee-4900-4de8-8235-1cccd8e7f0c5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:59.518798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-262800ee-4900-4de8-8235-1cccd8e7f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:59.528845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:59.664128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262800ee-4900-4de8-8235-1cccd8e7f0c5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:59.742226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:59.775075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106fd4a-4f2e-483f-8e7a-2c9c29b97055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:59.775681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106fd4a-4f2e-483f-8e7a-2c9c29b97055 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:59.775957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106fd4a-4f2e-483f-8e7a-2c9c29b97055 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:59.776225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106fd4a-4f2e-483f-8e7a-2c9c29b97055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:59.777916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2106fd4a-4f2e-483f-8e7a-2c9c29b97055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:28:59.865327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106fd4a-4f2e-483f-8e7a-2c9c29b97055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:59.866966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106fd4a-4f2e-483f-8e7a-2c9c29b97055 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:59.886812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 737/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:29:01.977992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ab24-468d-4e48-aa80-d8c93287ff6d None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:01.978571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ab24-468d-4e48-aa80-d8c93287ff6d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:01.978571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6ab24-468d-4e48-aa80-d8c93287ff6d None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:01.979935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 745/1482] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:29:01.985954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2c35a-40f7-43e9-b40a-ba9637e4f146 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:01.986366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2c35a-40f7-43e9-b40a-ba9637e4f146 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:01.986506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2c35a-40f7-43e9-b40a-ba9637e4f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:02.051746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-29a2c35a-40f7-43e9-b40a-ba9637e4f146 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:02.052964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-29a2c35a-40f7-43e9-b40a-ba9637e4f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:02.099972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:02.151852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 738/1483] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:02.441431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6ab24-468d-4e48-aa80-d8c93287ff6d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:02.443023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-57e6ab24-468d-4e48-aa80-d8c93287ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:02.466463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:02.549221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6ab24-468d-4e48-aa80-d8c93287ff6d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:02.621269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de40234-6fa7-4c79-9b0e-d465b106db52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:02.621913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40234-6fa7-4c79-9b0e-d465b106db52 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:02.622194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40234-6fa7-4c79-9b0e-d465b106db52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:02.622468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de40234-6fa7-4c79-9b0e-d465b106db52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:02.624968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6de40234-6fa7-4c79-9b0e-d465b106db52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:02.696894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:02.729880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40234-6fa7-4c79-9b0e-d465b106db52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:02.731349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de40234-6fa7-4c79-9b0e-d465b106db52 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:02.750817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 746/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:29:04.680925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f4997-5cbd-4efa-b4f5-7d73d73a2de8 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:04.681521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f4997-5cbd-4efa-b4f5-7d73d73a2de8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:04.681521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f4997-5cbd-4efa-b4f5-7d73d73a2de8 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:04.682858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 739/1485] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:29:04.688575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f27b-7673-4fda-830a-375b5e6d8474 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:04.688994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f27b-7673-4fda-830a-375b5e6d8474 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:04.689110 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f27b-7673-4fda-830a-375b5e6d8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:04.752604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1293f27b-7673-4fda-830a-375b5e6d8474 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:04.753817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1293f27b-7673-4fda-830a-375b5e6d8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:04.847586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 747/1486] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:05.137057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f4997-5cbd-4efa-b4f5-7d73d73a2de8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:05.138966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c77f4997-5cbd-4efa-b4f5-7d73d73a2de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:05.240280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f4997-5cbd-4efa-b4f5-7d73d73a2de8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:05.310597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:05.312370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238cd63d-3a92-47aa-b9b3-07ead2cca10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:05.312976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cd63d-3a92-47aa-b9b3-07ead2cca10a service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:05.313255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cd63d-3a92-47aa-b9b3-07ead2cca10a service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:05.313526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cd63d-3a92-47aa-b9b3-07ead2cca10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:05.315154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-238cd63d-3a92-47aa-b9b3-07ead2cca10a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:05.423986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cd63d-3a92-47aa-b9b3-07ead2cca10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:05.425351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238cd63d-3a92-47aa-b9b3-07ead2cca10a service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:05.443446 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 740/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:29:07.476100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53bbe9-2bdd-4274-ae75-fa170bdf204e None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:07.476617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53bbe9-2bdd-4274-ae75-fa170bdf204e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:07.476736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53bbe9-2bdd-4274-ae75-fa170bdf204e None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:07.478024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 748/1488] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:29:07.483873 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10812d-45b7-4298-b519-13183fe41a3d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:07.484307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10812d-45b7-4298-b519-13183fe41a3d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:07.484404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10812d-45b7-4298-b519-13183fe41a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:07.549584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bc10812d-45b7-4298-b519-13183fe41a3d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:07.550828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bc10812d-45b7-4298-b519-13183fe41a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:07.602415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:07.645949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 741/1489] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:07.932094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53bbe9-2bdd-4274-ae75-fa170bdf204e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:07.933686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cd53bbe9-2bdd-4274-ae75-fa170bdf204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:07.969965 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:08.039023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53bbe9-2bdd-4274-ae75-fa170bdf204e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:08.113521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3d8f-bd1e-4f2e-a78a-28271136f2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:08.114151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3d8f-bd1e-4f2e-a78a-28271136f2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:08.114432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3d8f-bd1e-4f2e-a78a-28271136f2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:08.114705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3d8f-bd1e-4f2e-a78a-28271136f2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:08.116295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-044e3d8f-bd1e-4f2e-a78a-28271136f2a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:08.194305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:08.222441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e3d8f-bd1e-4f2e-a78a-28271136f2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:08.223885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e3d8f-bd1e-4f2e-a78a-28271136f2a6 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:08.242342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 749/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:29:10.547991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22ae2-3bcd-46b2-a902-a8634d0664d9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:10.548572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22ae2-3bcd-46b2-a902-a8634d0664d9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:10.548572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b22ae2-3bcd-46b2-a902-a8634d0664d9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:10.549918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 742/1491] 10.222.0.61 () {54 vars in 927 bytes} [Tue Aug 23 16:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:29:10.555118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3740da-51f6-4c30-afbb-0cf019fdeae1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:10.555539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3740da-51f6-4c30-afbb-0cf019fdeae1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:10.555693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3740da-51f6-4c30-afbb-0cf019fdeae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:10.623908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-cc3740da-51f6-4c30-afbb-0cf019fdeae1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:10.625114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cc3740da-51f6-4c30-afbb-0cf019fdeae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:10.723028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 750/1492] 10.222.0.61 () {58 vars in 1024 bytes} [Tue Aug 23 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:11.012894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b22ae2-3bcd-46b2-a902-a8634d0664d9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:11.014556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-96b22ae2-3bcd-46b2-a902-a8634d0664d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:11.117752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b22ae2-3bcd-46b2-a902-a8634d0664d9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:11.188367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d87e0-e6fd-4c78-acca-a02f79eb5555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:11.188975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d87e0-e6fd-4c78-acca-a02f79eb5555 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:11.189252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d87e0-e6fd-4c78-acca-a02f79eb5555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:11.189520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d87e0-e6fd-4c78-acca-a02f79eb5555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:11.191134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5b8d87e0-e6fd-4c78-acca-a02f79eb5555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:11.200447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:11.299422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d87e0-e6fd-4c78-acca-a02f79eb5555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:11.300787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d87e0-e6fd-4c78-acca-a02f79eb5555 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:11.318392 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 743/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:29:20.721232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=82 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:21.316204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=50 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:31.745414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d440457-5976-4276-8f14-9d6e31e87001 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:31.746055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d440457-5976-4276-8f14-9d6e31e87001 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:31.746055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d440457-5976-4276-8f14-9d6e31e87001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:31.823431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-9d440457-5976-4276-8f14-9d6e31e87001 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:30:31.824661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9d440457-5976-4276-8f14-9d6e31e87001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:31.931821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 751/1494] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:30:31.939923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e09d4-cff3-42ef-86e4-b9c221a9d3e7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:31.940433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e09d4-cff3-42ef-86e4-b9c221a9d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:31.940533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e09d4-cff3-42ef-86e4-b9c221a9d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:32.015553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1b8e09d4-cff3-42ef-86e4-b9c221a9d3e7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:30:32.016678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1b8e09d4-cff3-42ef-86e4-b9c221a9d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:32.112140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 744/1495] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:30:32.116917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d440457-5976-4276-8f14-9d6e31e87001 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:32.118157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9d440457-5976-4276-8f14-9d6e31e87001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:32.130475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d440457-5976-4276-8f14-9d6e31e87001 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:32.193363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:32.226756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:32.227360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:32.227640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:32.227907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:32.228544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:30:32.228842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:32.229893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING py.warnings [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:30:32.229893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: warnings.warn(msg) Aug 23 16:30:32.229893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: Aug 23 16:30:32.230772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:32.241862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 752/1496] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:30:32.250498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e09d4-cff3-42ef-86e4-b9c221a9d3e7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:32.260737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e09d4-cff3-42ef-86e4-b9c221a9d3e7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:32.323242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:32.358804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:32.362842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:32.362842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:32.362842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:32.362842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:32.362842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:30:32.362842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 23 16:30:32.362842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: Aug 23 16:30:32.363482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:32.485867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 745/1497] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:30:32 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:30:32.490071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:32.491592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:32.526683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191aa1a-6a08-4df6-842f-7996a351a2b3 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:32.622428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:32.623563 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:32.623841 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:32.624109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:32.624722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:32.626040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING py.warnings [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:30:32.626040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: warnings.warn(msg) Aug 23 16:30:32.626040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: Aug 23 16:30:32.627240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:32.750065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 753/1498] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:30:32 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:30:32.754457 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:32.756004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:32.818172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1994c-f434-4b9e-ac96-a33fa83ee6b3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:32.903350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:32.914133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:32.919520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:32.919520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:32.919520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:32.919520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:32.919520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:30:32.919520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 23 16:30:32.919520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: Aug 23 16:30:32.920171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:32.930088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 746/1499] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:30:32.934460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:32.936665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:32.948357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68792df5-9a5e-4183-aa9d-40c565b4846e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:32.975679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:33.048663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7871a-d162-4d0a-ad0f-2e12e543ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:33.049275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7871a-d162-4d0a-ad0f-2e12e543ecd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:33.049559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7871a-d162-4d0a-ad0f-2e12e543ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:33.049871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7871a-d162-4d0a-ad0f-2e12e543ecd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:33.050520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7871a-d162-4d0a-ad0f-2e12e543ecd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:33.051570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING py.warnings [None req-e2f7871a-d162-4d0a-ad0f-2e12e543ecd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:30:33.051570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: warnings.warn(msg) Aug 23 16:30:33.051570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: Aug 23 16:30:33.052462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f7871a-d162-4d0a-ad0f-2e12e543ecd8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:33.066655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 754/1500] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:30:33.069883 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:33.071481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:33.105404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f46de-bcf9-4538-b585-4c6253a2af85 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:33.201253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab70a5-6254-47c8-90ab-cc0e09d4e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:33.201873 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab70a5-6254-47c8-90ab-cc0e09d4e3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:33.202152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab70a5-6254-47c8-90ab-cc0e09d4e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:33.202424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab70a5-6254-47c8-90ab-cc0e09d4e3ba admin admin] PATH_INFO: `/v3/projects/e525bcc3621a4dc3aa18a8df43398f48/users/8a9b1f9229d44ee7bcb89b90c3ecd270/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:33.224549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab70a5-6254-47c8-90ab-cc0e09d4e3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e525bcc3621a4dc3aa18a8df43398f48, user_id=8a9b1f9229d44ee7bcb89b90c3ecd270, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:33.225585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-81ab70a5-6254-47c8-90ab-cc0e09d4e3ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:30:33.225585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 23 16:30:33.225585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: Aug 23 16:30:33.227568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab70a5-6254-47c8-90ab-cc0e09d4e3ba admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:33.331702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 747/1501] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:30:33 2022] PUT /identity/v3/projects/e525bcc3621a4dc3aa18a8df43398f48/users/8a9b1f9229d44ee7bcb89b90c3ecd270/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:30:33.344120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d4a7-f5eb-4b5e-b747-322edd7f5581 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:33.344418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d4a7-f5eb-4b5e-b747-322edd7f5581 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:33.344700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d4a7-f5eb-4b5e-b747-322edd7f5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:33.402152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7569d4a7-f5eb-4b5e-b747-322edd7f5581 None None] MFA Rules not processed for user `8a9b1f9229d44ee7bcb89b90c3ecd270`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:30:33.403359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7569d4a7-f5eb-4b5e-b747-322edd7f5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:33.483936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 755/1502] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:30:33.499688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332ed1f-9518-4320-8618-decc410438c9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:33.499978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332ed1f-9518-4320-8618-decc410438c9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:33.500270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332ed1f-9518-4320-8618-decc410438c9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:33.502487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 748/1503] 10.222.0.61 () {54 vars in 964 bytes} [Tue Aug 23 16:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:30:33.507271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee306a3-35e6-4fff-93dc-35a930d5c129 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:33.507568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee306a3-35e6-4fff-93dc-35a930d5c129 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:33.507847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee306a3-35e6-4fff-93dc-35a930d5c129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:33.540647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:33.585923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-bee306a3-35e6-4fff-93dc-35a930d5c129 None None] MFA Rules not processed for user `1a81f47e4b004716bf54175c55606d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:30:33.587133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bee306a3-35e6-4fff-93dc-35a930d5c129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:33.664474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 756/1504] 10.222.0.61 () {58 vars in 1061 bytes} [Tue Aug 23 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:30:33.673120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332ed1f-9518-4320-8618-decc410438c9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:33.674872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9332ed1f-9518-4320-8618-decc410438c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:33.725686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:33.778647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332ed1f-9518-4320-8618-decc410438c9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:33.854104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:33.854731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:33.855367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:33.855367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:33.856922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:33.968694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:33.970199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:33.973639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:33.989464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 749/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:30:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:30:34.035658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dce398-7eed-48a0-9b7a-7b17c5c095ed None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:34.036115 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dce398-7eed-48a0-9b7a-7b17c5c095ed None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:34.036222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dce398-7eed-48a0-9b7a-7b17c5c095ed None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:34.037445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 757/1506] 10.222.0.61 () {52 vars in 830 bytes} [Tue Aug 23 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:30:34.040971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:34.042307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:34.144503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a369bcf-fd7f-4f8a-a618-091be8f1cfa6 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:34.237562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:34.238283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:34.238506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:34.238777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] PATH_INFO: `/v3/users/8a9b1f9229d44ee7bcb89b90c3ecd270` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:34.251443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9b1f9229d44ee7bcb89b90c3ecd270)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:34.252469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:30:34.252469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 23 16:30:34.252469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: Aug 23 16:30:34.253829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:34.263907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:34.481337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9b1f9229d44ee7bcb89b90c3ecd270'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:34.495182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9b1f9229d44ee7bcb89b90c3ecd270'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:34.496267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9b1f9229d44ee7bcb89b90c3ecd270'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:34.496267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9b1f9229d44ee7bcb89b90c3ecd270'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:34.519612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9b1f9229d44ee7bcb89b90c3ecd270'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:34.604179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 750/1507] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:30:34 2022] DELETE /identity/v3/users/8a9b1f9229d44ee7bcb89b90c3ecd270 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:30:34.608594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702d0ae-3557-4c21-ace6-7d3a57ea5b72 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:34.608881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702d0ae-3557-4c21-ace6-7d3a57ea5b72 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:34.609156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702d0ae-3557-4c21-ace6-7d3a57ea5b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:34.670156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-6702d0ae-3557-4c21-ace6-7d3a57ea5b72 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:30:34.671371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6702d0ae-3557-4c21-ace6-7d3a57ea5b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:34.745148 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:34.757811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 758/1508] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:30:34.767930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:34.769163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:34.867198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1d036-21df-4a33-9fe0-04b6f546f5b5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:34.924318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:34.943645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd21f78-813b-4e4a-9792-a0b621a2b5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:34.944255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21f78-813b-4e4a-9792-a0b621a2b5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:34.944535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21f78-813b-4e4a-9792-a0b621a2b5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:34.944806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd21f78-813b-4e4a-9792-a0b621a2b5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:34.946473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cdd21f78-813b-4e4a-9792-a0b621a2b5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:35.058478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd21f78-813b-4e4a-9792-a0b621a2b5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:35.059894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd21f78-813b-4e4a-9792-a0b621a2b5e3 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:35.078850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 751/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:30:35.583663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702d0ae-3557-4c21-ace6-7d3a57ea5b72 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:35.584939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6702d0ae-3557-4c21-ace6-7d3a57ea5b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:35.597315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702d0ae-3557-4c21-ace6-7d3a57ea5b72 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:35.692412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:35.693045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:35.693324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:35.693598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] PATH_INFO: `/v3/projects/e525bcc3621a4dc3aa18a8df43398f48` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:35.704476 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e525bcc3621a4dc3aa18a8df43398f48)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:35.705507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING py.warnings [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:30:35.705507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: warnings.warn(msg) Aug 23 16:30:35.705507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: Aug 23 16:30:35.706722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:35.820223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e525bcc3621a4dc3aa18a8df43398f48', 'request_id': 'req-b26e8c75-4eb6-40a6-9c9b-d251721a711b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:35.833658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e525bcc3621a4dc3aa18a8df43398f48', 'request_id': 'req-b26e8c75-4eb6-40a6-9c9b-d251721a711b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:35.899143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e525bcc3621a4dc3aa18a8df43398f48', 'request_id': 'req-b26e8c75-4eb6-40a6-9c9b-d251721a711b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:35.923747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] The token cache is being invalidate because project e525bcc3621a4dc3aa18a8df43398f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:30:35.924037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:35.924467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b26e8c75-4eb6-40a6-9c9b-d251721a711b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:30:35.926184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 759/1510] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:30:35 2022] DELETE /identity/v3/projects/e525bcc3621a4dc3aa18a8df43398f48 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:30:45.076403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=62 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:45.921681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:20.967506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d0455-e75e-4f6e-ad86-c7a2c8c25313 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:20.968119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d0455-e75e-4f6e-ad86-c7a2c8c25313 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:20.968119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d0455-e75e-4f6e-ad86-c7a2c8c25313 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:20.969455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:20.974407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05efc-dc7a-4735-802c-6c45190df9d2 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:20.974878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05efc-dc7a-4735-802c-6c45190df9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:20.974982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05efc-dc7a-4735-802c-6c45190df9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:21.055580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-3fd05efc-dc7a-4735-802c-6c45190df9d2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:21.056878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3fd05efc-dc7a-4735-802c-6c45190df9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:21.160623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:21.313659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d0455-e75e-4f6e-ad86-c7a2c8c25313 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:21.315799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-526d0455-e75e-4f6e-ad86-c7a2c8c25313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:21.433632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d0455-e75e-4f6e-ad86-c7a2c8c25313 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:21.439121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8eff6f-b7d7-4ebc-a314-ae039044427b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:21.439722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eff6f-b7d7-4ebc-a314-ae039044427b service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:21.440001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eff6f-b7d7-4ebc-a314-ae039044427b service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:21.440272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eff6f-b7d7-4ebc-a314-ae039044427b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:21.448752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8eff6f-b7d7-4ebc-a314-ae039044427b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:21.450381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8eff6f-b7d7-4ebc-a314-ae039044427b service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:21.459984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 753/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:22.281917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e66406-5b8f-4b7c-8019-15b704995843 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:22.282449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e66406-5b8f-4b7c-8019-15b704995843 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:22.282449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e66406-5b8f-4b7c-8019-15b704995843 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:22.283816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:22.288687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202e03-d2a1-4cfe-9fef-1369ff524cb4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:22.289144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202e03-d2a1-4cfe-9fef-1369ff524cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:22.289246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca202e03-d2a1-4cfe-9fef-1369ff524cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:22.308575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ca202e03-d2a1-4cfe-9fef-1369ff524cb4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:22.309847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ca202e03-d2a1-4cfe-9fef-1369ff524cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:22.317479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:32:22.468926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e66406-5b8f-4b7c-8019-15b704995843 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:22.484160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e66406-5b8f-4b7c-8019-15b704995843 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:22.489468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b573a-2cf6-4b1c-990e-39df9177c69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:22.490082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b573a-2cf6-4b1c-990e-39df9177c69b service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:22.490363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b573a-2cf6-4b1c-990e-39df9177c69b service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:22.490659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b573a-2cf6-4b1c-990e-39df9177c69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:22.498584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b573a-2cf6-4b1c-990e-39df9177c69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:22.500165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b573a-2cf6-4b1c-990e-39df9177c69b service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:22.509707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 762/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:22.625216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255abbc2-ea08-4ca7-b02e-3fcb38e3e5da None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:22.625528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255abbc2-ea08-4ca7-b02e-3fcb38e3e5da None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:22.625848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255abbc2-ea08-4ca7-b02e-3fcb38e3e5da None None] PATH_INFO: `/v3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:22.627140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 755/1517] 10.222.0.67 () {54 vars in 925 bytes} [Tue Aug 23 16:32:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:32:22.634031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3a85-07cd-43c5-a208-664975c4a1cb None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:22.634323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3a85-07cd-43c5-a208-664975c4a1cb None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:22.634730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3a85-07cd-43c5-a208-664975c4a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:22.692637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1a7c3a85-07cd-43c5-a208-664975c4a1cb None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:22.694355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1a7c3a85-07cd-43c5-a208-664975c4a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:22.710833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:22.767854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 763/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Tue Aug 23 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:32.304083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=56 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:32.602144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ab1b-4d91-4454-bad2-3783a195abbc None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:32.602434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ab1b-4d91-4454-bad2-3783a195abbc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:32.602712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209ab1b-4d91-4454-bad2-3783a195abbc None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:32.604054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 756/1519] 10.222.0.61 () {54 vars in 961 bytes} [Tue Aug 23 16:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:32.609028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9fed7-8f3a-4907-a5e8-92a9bee32e41 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:32.609512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9fed7-8f3a-4907-a5e8-92a9bee32e41 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:32.609649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9fed7-8f3a-4907-a5e8-92a9bee32e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:32.629005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-30b9fed7-8f3a-4907-a5e8-92a9bee32e41 None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:32.630470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-30b9fed7-8f3a-4907-a5e8-92a9bee32e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:32.638874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 764/1520] 10.222.0.61 () {58 vars in 1058 bytes} [Tue Aug 23 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:32.646324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ab1b-4d91-4454-bad2-3783a195abbc None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:32.659827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209ab1b-4d91-4454-bad2-3783a195abbc None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:32.665139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09cca0-ecbc-4e14-b00b-68e97d637034 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:32.665747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cca0-ecbc-4e14-b00b-68e97d637034 service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:32.666031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cca0-ecbc-4e14-b00b-68e97d637034 service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:32.666306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09cca0-ecbc-4e14-b00b-68e97d637034 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:32.674339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09cca0-ecbc-4e14-b00b-68e97d637034 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:32.675931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09cca0-ecbc-4e14-b00b-68e97d637034 service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:32.686056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 757/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:33.730010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5dc17-3a82-4737-851f-080c6ad5ab14 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:33.730639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5dc17-3a82-4737-851f-080c6ad5ab14 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:33.730639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5dc17-3a82-4737-851f-080c6ad5ab14 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:33.731921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:33.736839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddaa91-198a-462f-9b16-a9fe51e0db9e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:33.737308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddaa91-198a-462f-9b16-a9fe51e0db9e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:33.737448 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddaa91-198a-462f-9b16-a9fe51e0db9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:33.757777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-61ddaa91-198a-462f-9b16-a9fe51e0db9e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:33.758954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-61ddaa91-198a-462f-9b16-a9fe51e0db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:33.766705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:32:33.920094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5dc17-3a82-4737-851f-080c6ad5ab14 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:33.934805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5dc17-3a82-4737-851f-080c6ad5ab14 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:33.940476 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d3fd4-9789-4232-a31a-f9bd5dfc1368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:33.942458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3fd4-9789-4232-a31a-f9bd5dfc1368 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:33.942458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3fd4-9789-4232-a31a-f9bd5dfc1368 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:33.942458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3fd4-9789-4232-a31a-f9bd5dfc1368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:33.949864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d3fd4-9789-4232-a31a-f9bd5dfc1368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:33.951445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d3fd4-9789-4232-a31a-f9bd5dfc1368 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:33.960677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 766/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:34.791531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d827-0f7e-4ec3-9667-865f807a7fa0 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:34.792121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d827-0f7e-4ec3-9667-865f807a7fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:34.792121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48d827-0f7e-4ec3-9667-865f807a7fa0 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:34.793579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:34.798497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014e5f-6a81-4767-96de-7e4b7a80b856 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:34.798946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014e5f-6a81-4767-96de-7e4b7a80b856 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:34.799065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1014e5f-6a81-4767-96de-7e4b7a80b856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:34.821942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d1014e5f-6a81-4767-96de-7e4b7a80b856 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:34.823138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d1014e5f-6a81-4767-96de-7e4b7a80b856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:34.830835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:34.984271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48d827-0f7e-4ec3-9667-865f807a7fa0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:34.999008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48d827-0f7e-4ec3-9667-865f807a7fa0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:35.004317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2674e-a679-4ba6-a609-8c98a787008f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:35.004918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2674e-a679-4ba6-a609-8c98a787008f service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:35.005183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2674e-a679-4ba6-a609-8c98a787008f service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:35.005744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2674e-a679-4ba6-a609-8c98a787008f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:35.014217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2674e-a679-4ba6-a609-8c98a787008f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:35.015794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2674e-a679-4ba6-a609-8c98a787008f service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:35.024928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 760/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:38.960238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72839f50-70d7-4478-ad60-920bdd5cbbf2 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:38.960825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72839f50-70d7-4478-ad60-920bdd5cbbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:38.960825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72839f50-70d7-4478-ad60-920bdd5cbbf2 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:38.962170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:38.967315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7929-04b1-4f4d-9830-24e6e06b6a76 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:38.967805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7929-04b1-4f4d-9830-24e6e06b6a76 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:38.967923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7929-04b1-4f4d-9830-24e6e06b6a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:38.988783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e8bc7929-04b1-4f4d-9830-24e6e06b6a76 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:38.990006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e8bc7929-04b1-4f4d-9830-24e6e06b6a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:38.997717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:39.279344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72839f50-70d7-4478-ad60-920bdd5cbbf2 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:39.281107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-72839f50-70d7-4478-ad60-920bdd5cbbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:39.359799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72839f50-70d7-4478-ad60-920bdd5cbbf2 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:39.363474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f6463-2357-466e-9870-a238dee31212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:39.364080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f6463-2357-466e-9870-a238dee31212 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:39.364365 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f6463-2357-466e-9870-a238dee31212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:39.364638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f6463-2357-466e-9870-a238dee31212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:39.374267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f6463-2357-466e-9870-a238dee31212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:39.375710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f6463-2357-466e-9870-a238dee31212 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:39.385766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 769/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:41.266565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96803e25-7b25-4a63-aec0-5bd6ffa3c3bd None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:41.267130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96803e25-7b25-4a63-aec0-5bd6ffa3c3bd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:41.267130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96803e25-7b25-4a63-aec0-5bd6ffa3c3bd None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:41.268475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:32:41.274265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4907ef-4034-4c7d-abb7-c158125bf0ab None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:41.274726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4907ef-4034-4c7d-abb7-c158125bf0ab None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:41.274835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4907ef-4034-4c7d-abb7-c158125bf0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:41.294405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7b4907ef-4034-4c7d-abb7-c158125bf0ab None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:41.295611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7b4907ef-4034-4c7d-abb7-c158125bf0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:41.303701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:41.584059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96803e25-7b25-4a63-aec0-5bd6ffa3c3bd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:41.586410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-96803e25-7b25-4a63-aec0-5bd6ffa3c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:41.599376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96803e25-7b25-4a63-aec0-5bd6ffa3c3bd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:41.602818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9930f9-f0a1-410d-8ed8-6c89ed754856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:41.603408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9930f9-f0a1-410d-8ed8-6c89ed754856 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:41.603695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9930f9-f0a1-410d-8ed8-6c89ed754856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:41.603967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9930f9-f0a1-410d-8ed8-6c89ed754856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:41.612615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9930f9-f0a1-410d-8ed8-6c89ed754856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:41.614072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9930f9-f0a1-410d-8ed8-6c89ed754856 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:41.623433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 763/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:45.056567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d13f6-5307-4289-85b0-53cf4e18294b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:45.057123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d13f6-5307-4289-85b0-53cf4e18294b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:45.057123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d13f6-5307-4289-85b0-53cf4e18294b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:45.058438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:45.063882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0ae6-312f-4209-8af8-f0d7da91a66b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:45.064314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0ae6-312f-4209-8af8-f0d7da91a66b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:45.064422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f0ae6-312f-4209-8af8-f0d7da91a66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:45.083877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-812f0ae6-312f-4209-8af8-f0d7da91a66b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:45.085694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-812f0ae6-312f-4209-8af8-f0d7da91a66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:45.093572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:45.638567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d13f6-5307-4289-85b0-53cf4e18294b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:45.640291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fa0d13f6-5307-4289-85b0-53cf4e18294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:45.704691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:45.717982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d13f6-5307-4289-85b0-53cf4e18294b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:45.725483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253944e-1dd8-4689-951d-166861e4fc17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:45.725483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253944e-1dd8-4689-951d-166861e4fc17 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:45.725483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253944e-1dd8-4689-951d-166861e4fc17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:45.725483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253944e-1dd8-4689-951d-166861e4fc17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:45.731848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253944e-1dd8-4689-951d-166861e4fc17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:45.733339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253944e-1dd8-4689-951d-166861e4fc17 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:45.743366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 772/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:47.662814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0869607-b936-4142-a135-2d2ba3de4f8e None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:47.663423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0869607-b936-4142-a135-2d2ba3de4f8e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:47.663423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0869607-b936-4142-a135-2d2ba3de4f8e None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:47.664719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:32:47.669968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e185d3-162c-49eb-99af-93548ada40ae None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:47.670393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e185d3-162c-49eb-99af-93548ada40ae None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:47.670529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e185d3-162c-49eb-99af-93548ada40ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:47.691022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-51e185d3-162c-49eb-99af-93548ada40ae None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:47.692263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-51e185d3-162c-49eb-99af-93548ada40ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:47.700678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:48.251001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0869607-b936-4142-a135-2d2ba3de4f8e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:48.252671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a0869607-b936-4142-a135-2d2ba3de4f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:48.265677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0869607-b936-4142-a135-2d2ba3de4f8e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:48.269359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c398e-68c7-4963-aa56-42e455532352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:48.270058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c398e-68c7-4963-aa56-42e455532352 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:48.270343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c398e-68c7-4963-aa56-42e455532352 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:48.270614 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c398e-68c7-4963-aa56-42e455532352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:48.279406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c398e-68c7-4963-aa56-42e455532352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:48.280832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c398e-68c7-4963-aa56-42e455532352 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:48.290388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 766/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:32:57.686394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=11 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:58.285936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=33 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:17.032311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7db53-cd78-449b-907a-bee136f6d8d9 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.033159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7db53-cd78-449b-907a-bee136f6d8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.033159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7db53-cd78-449b-907a-bee136f6d8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.070793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-39c7db53-cd78-449b-907a-bee136f6d8d9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.072014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-39c7db53-cd78-449b-907a-bee136f6d8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.084487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 774/1540] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.093598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096055d5-7d38-41f5-9348-55177ecc1c6f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.094221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096055d5-7d38-41f5-9348-55177ecc1c6f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.094221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096055d5-7d38-41f5-9348-55177ecc1c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.122609 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-096055d5-7d38-41f5-9348-55177ecc1c6f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.123831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-096055d5-7d38-41f5-9348-55177ecc1c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.135495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 767/1541] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.142921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7db53-cd78-449b-907a-bee136f6d8d9 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.159068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7db53-cd78-449b-907a-bee136f6d8d9 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.167324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b43cd-e289-4e71-9987-49a3aa7cd638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.167944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b43cd-e289-4e71-9987-49a3aa7cd638 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.168226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b43cd-e289-4e71-9987-49a3aa7cd638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.168499 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b43cd-e289-4e71-9987-49a3aa7cd638 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.169161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b43cd-e289-4e71-9987-49a3aa7cd638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:17.169463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b43cd-e289-4e71-9987-49a3aa7cd638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.171115 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b43cd-e289-4e71-9987-49a3aa7cd638 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.188619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 775/1542] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:17.198356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096055d5-7d38-41f5-9348-55177ecc1c6f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.210944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096055d5-7d38-41f5-9348-55177ecc1c6f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.219500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890a55-a29f-4155-bc73-84829477f806 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.220111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890a55-a29f-4155-bc73-84829477f806 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.220395 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87890a55-a29f-4155-bc73-84829477f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.223646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6908ac-7a1d-47e3-8509-04e664977989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.224321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6908ac-7a1d-47e3-8509-04e664977989 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.224604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6908ac-7a1d-47e3-8509-04e664977989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.224878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6908ac-7a1d-47e3-8509-04e664977989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.225544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6908ac-7a1d-47e3-8509-04e664977989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.227538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6908ac-7a1d-47e3-8509-04e664977989 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.253554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-87890a55-a29f-4155-bc73-84829477f806 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.254827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-87890a55-a29f-4155-bc73-84829477f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.269242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 776/1543] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.275186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979fd5-758d-4e7e-b9dc-8dc7eac9abf6 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.275186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979fd5-758d-4e7e-b9dc-8dc7eac9abf6 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.275186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c979fd5-758d-4e7e-b9dc-8dc7eac9abf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.298283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-6c979fd5-758d-4e7e-b9dc-8dc7eac9abf6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.300576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6c979fd5-758d-4e7e-b9dc-8dc7eac9abf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.309138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 777/1544] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.313690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0657f-6434-480a-8431-523bc5fa5288 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.313690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0657f-6434-480a-8431-523bc5fa5288 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.313690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0657f-6434-480a-8431-523bc5fa5288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.335214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b9a0657f-6434-480a-8431-523bc5fa5288 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.336560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b9a0657f-6434-480a-8431-523bc5fa5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.344490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 778/1545] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.345812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985ba2-b31b-43f7-a7de-7b9345c60c09 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.346100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985ba2-b31b-43f7-a7de-7b9345c60c09 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.346385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985ba2-b31b-43f7-a7de-7b9345c60c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.366101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-86985ba2-b31b-43f7-a7de-7b9345c60c09 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.367295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-86985ba2-b31b-43f7-a7de-7b9345c60c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.382189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 768/1546] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:17.389901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 779/1547] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.390043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3ba0-f9da-4ff7-ba9c-fd44f80986f7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.390043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3ba0-f9da-4ff7-ba9c-fd44f80986f7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.390043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3ba0-f9da-4ff7-ba9c-fd44f80986f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.390292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e870-2b5f-4617-a075-d4ae7f67a391 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.390292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e870-2b5f-4617-a075-d4ae7f67a391 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.390292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e870-2b5f-4617-a075-d4ae7f67a391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.401511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-a5e2e870-2b5f-4617-a075-d4ae7f67a391 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.402763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a5e2e870-2b5f-4617-a075-d4ae7f67a391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.404430 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e46d3ba0-f9da-4ff7-ba9c-fd44f80986f7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.405963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e46d3ba0-f9da-4ff7-ba9c-fd44f80986f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.474027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 780/1548] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.474027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404720-d2a7-4159-975a-b237b4c76979 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.474027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404720-d2a7-4159-975a-b237b4c76979 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.474027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404720-d2a7-4159-975a-b237b4c76979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.476866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 769/1549] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.478236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824520-6277-4edd-a39d-4a1e41165cc9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.478542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824520-6277-4edd-a39d-4a1e41165cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.478893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824520-6277-4edd-a39d-4a1e41165cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.495573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-80404720-d2a7-4159-975a-b237b4c76979 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.496778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-80404720-d2a7-4159-975a-b237b4c76979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.498078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-17824520-6277-4edd-a39d-4a1e41165cc9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.499229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-17824520-6277-4edd-a39d-4a1e41165cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.504923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 781/1550] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.506161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4b796-1ef2-4deb-baa9-d514046a245b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.506444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4b796-1ef2-4deb-baa9-d514046a245b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.506716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4b796-1ef2-4deb-baa9-d514046a245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.510691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 770/1551] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.511447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17824520-6277-4edd-a39d-4a1e41165cc9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.521074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17824520-6277-4edd-a39d-4a1e41165cc9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.525549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.526166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.526444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.526710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.527324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.528461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:34:17.528461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 23 16:34:17.528461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: Aug 23 16:34:17.529666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.530920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-a2d4b796-1ef2-4deb-baa9-d514046a245b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.532132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a2d4b796-1ef2-4deb-baa9-d514046a245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.540531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 782/1552] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.541740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f1551-8ea6-4d36-9291-74ff2796822f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.542022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f1551-8ea6-4d36-9291-74ff2796822f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.542296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f1551-8ea6-4d36-9291-74ff2796822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.561883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-a90f1551-8ea6-4d36-9291-74ff2796822f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.562967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a90f1551-8ea6-4d36-9291-74ff2796822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.570800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 783/1553] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.571992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91338-710d-477c-80c6-90c87f8654fc None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.572337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91338-710d-477c-80c6-90c87f8654fc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.572609 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f91338-710d-477c-80c6-90c87f8654fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.591146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-20f91338-710d-477c-80c6-90c87f8654fc None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.592327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-20f91338-710d-477c-80c6-90c87f8654fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.600573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 784/1554] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.601874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664dbe-7097-4a29-b563-818cbd2e1dc2 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.602158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664dbe-7097-4a29-b563-818cbd2e1dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.602430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664dbe-7097-4a29-b563-818cbd2e1dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.617905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 771/1555] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:17.617905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.623239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1f664dbe-7097-4a29-b563-818cbd2e1dc2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.624478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1f664dbe-7097-4a29-b563-818cbd2e1dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.627125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cad7c-44bb-40e0-a1b1-754f767dad64 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.631873 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997e607-e4d2-4bb8-820c-c2751ec5564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.632461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e607-e4d2-4bb8-820c-c2751ec5564b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.632594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 785/1556] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.632740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e607-e4d2-4bb8-820c-c2751ec5564b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.633016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e607-e4d2-4bb8-820c-c2751ec5564b admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.633234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f664dbe-7097-4a29-b563-818cbd2e1dc2 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.633691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997e607-e4d2-4bb8-820c-c2751ec5564b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:17.633997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997e607-e4d2-4bb8-820c-c2751ec5564b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.635270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-e997e607-e4d2-4bb8-820c-c2751ec5564b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:34:17.635270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 23 16:34:17.635270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: Aug 23 16:34:17.636549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997e607-e4d2-4bb8-820c-c2751ec5564b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.642900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f664dbe-7097-4a29-b563-818cbd2e1dc2 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.647607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.648196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.648478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.648752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.648867 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 772/1557] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:17.649986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5856-e17d-44e0-b43d-2dd43ffd6db8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.650277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5856-e17d-44e0-b43d-2dd43ffd6db8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.650553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e5856-e17d-44e0-b43d-2dd43ffd6db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.654456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:17.654870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.656679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.669393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 786/1558] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:17.669950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c68e5856-e17d-44e0-b43d-2dd43ffd6db8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.670496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.671163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c68e5856-e17d-44e0-b43d-2dd43ffd6db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.679663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 773/1559] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.680450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e5856-e17d-44e0-b43d-2dd43ffd6db8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.682286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896c799-79a3-4f21-bee9-39ff9c305f92 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.687036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bd5d7-75c3-44bb-a4c7-12fb9da88338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.687686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd5d7-75c3-44bb-a4c7-12fb9da88338 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.687968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd5d7-75c3-44bb-a4c7-12fb9da88338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.688235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bd5d7-75c3-44bb-a4c7-12fb9da88338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.688868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bd5d7-75c3-44bb-a4c7-12fb9da88338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:17.689216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bd5d7-75c3-44bb-a4c7-12fb9da88338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.690039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e5856-e17d-44e0-b43d-2dd43ffd6db8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.690869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bd5d7-75c3-44bb-a4c7-12fb9da88338 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.694822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.695434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.695714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.695986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.696677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:17.696978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.698581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.702904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 787/1560] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:17.704076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa18c4-5289-4cac-b4ce-31008e5f5046 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.704359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa18c4-5289-4cac-b4ce-31008e5f5046 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.716108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa18c4-5289-4cac-b4ce-31008e5f5046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.716252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 774/1561] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:17.716252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.726575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6cfbe0-7f2b-4a2b-92a9-f21d68cc68dc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.729001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-affa18c4-5289-4cac-b4ce-31008e5f5046 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:17.730216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-affa18c4-5289-4cac-b4ce-31008e5f5046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:17.731579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222da7ed-367e-4eb1-9ded-7bae8004ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.732179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da7ed-367e-4eb1-9ded-7bae8004ccd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.732463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da7ed-367e-4eb1-9ded-7bae8004ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.732745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222da7ed-367e-4eb1-9ded-7bae8004ccd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.733418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222da7ed-367e-4eb1-9ded-7bae8004ccd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.735052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222da7ed-367e-4eb1-9ded-7bae8004ccd5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.738871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 788/1562] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:17.739725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa18c4-5289-4cac-b4ce-31008e5f5046 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.748984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 775/1563] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:17.748984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222da7ed-367e-4eb1-9ded-7bae8004ccd5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.749535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa18c4-5289-4cac-b4ce-31008e5f5046 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.754146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.754736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.755015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.755281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.755915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:17.756211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.757817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.758225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222da7ed-367e-4eb1-9ded-7bae8004ccd5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.763159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ccbd-1b51-49c4-8eb0-eb5c1505ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.763732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ccbd-1b51-49c4-8eb0-eb5c1505ea82 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.764012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ccbd-1b51-49c4-8eb0-eb5c1505ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.764285 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ccbd-1b51-49c4-8eb0-eb5c1505ea82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.764897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325ccbd-1b51-49c4-8eb0-eb5c1505ea82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.766805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325ccbd-1b51-49c4-8eb0-eb5c1505ea82 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.770047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 789/1564] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:17.770820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.781797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf5712-05cd-4758-a93a-ccd58a07f155 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.786953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.787568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.787851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.788122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.788738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.789797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING py.warnings [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:34:17.789797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: warnings.warn(msg) Aug 23 16:34:17.789797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: Aug 23 16:34:17.796511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:17.879250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 776/1565] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:17.880145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ccbd-1b51-49c4-8eb0-eb5c1505ea82 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.907819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 790/1566] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:17.909190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:17.919608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:17.923233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:17.946620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ccbd-1b51-49c4-8eb0-eb5c1505ea82 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.970778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc343a03-ba4c-4dce-9f06-8e35bebf4e5e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:17.975878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298e439-67e6-47fc-9429-3d1fd8646a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:17.976533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298e439-67e6-47fc-9429-3d1fd8646a3e admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:17.976795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298e439-67e6-47fc-9429-3d1fd8646a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:17.977066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298e439-67e6-47fc-9429-3d1fd8646a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:17.977712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298e439-67e6-47fc-9429-3d1fd8646a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:17.979632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298e439-67e6-47fc-9429-3d1fd8646a3e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.005271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.005908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.006194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.006473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.007118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:18.007422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.009027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.020777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 777/1567] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:18.021544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.035020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdc62e-9d5d-4787-8aea-effeb9e2d115 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.039732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdcbde-6d51-4026-af0c-c39f70596f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.040318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdcbde-6d51-4026-af0c-c39f70596f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.040599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdcbde-6d51-4026-af0c-c39f70596f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.040898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdcbde-6d51-4026-af0c-c39f70596f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.041518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdcbde-6d51-4026-af0c-c39f70596f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.043442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdcbde-6d51-4026-af0c-c39f70596f4f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.139316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 791/1568] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:17 2022] POST /identity/v3/projects => generated 371 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.140244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298e439-67e6-47fc-9429-3d1fd8646a3e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.168359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 778/1569] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.169111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdcbde-6d51-4026-af0c-c39f70596f4f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.203622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298e439-67e6-47fc-9429-3d1fd8646a3e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.234216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdcbde-6d51-4026-af0c-c39f70596f4f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.240038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5512-de76-4032-8b21-6d70d410d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.240311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5512-de76-4032-8b21-6d70d410d690 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.240597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5512-de76-4032-8b21-6d70d410d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.240872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5512-de76-4032-8b21-6d70d410d690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.241520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb5512-de76-4032-8b21-6d70d410d690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.243595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb5512-de76-4032-8b21-6d70d410d690 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.257857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 779/1570] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:18.258773 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5512-de76-4032-8b21-6d70d410d690 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.260927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.261701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.261982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.262251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.262895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:18.263194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.264786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.268721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5512-de76-4032-8b21-6d70d410d690 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.273300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213b6c1-d018-44e7-91dc-d972d7df758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.273918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213b6c1-d018-44e7-91dc-d972d7df758a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.274202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213b6c1-d018-44e7-91dc-d972d7df758a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.274476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213b6c1-d018-44e7-91dc-d972d7df758a admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.275091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213b6c1-d018-44e7-91dc-d972d7df758a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.276393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 792/1571] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:18.277018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213b6c1-d018-44e7-91dc-d972d7df758a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.277286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.287341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c6275-92cb-4513-9a8e-4b3bf8810780 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.293599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d79ae-447c-49b7-af8e-a472e45aa9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.293599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d79ae-447c-49b7-af8e-a472e45aa9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.293599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d79ae-447c-49b7-af8e-a472e45aa9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.293599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d79ae-447c-49b7-af8e-a472e45aa9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.294022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d79ae-447c-49b7-af8e-a472e45aa9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.295730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d79ae-447c-49b7-af8e-a472e45aa9e1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.480120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 780/1572] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.481011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213b6c1-d018-44e7-91dc-d972d7df758a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.510913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:18.532201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 793/1573] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.533013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d79ae-447c-49b7-af8e-a472e45aa9e1 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.542927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d79ae-447c-49b7-af8e-a472e45aa9e1 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.543091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213b6c1-d018-44e7-91dc-d972d7df758a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.547392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7505b8-dec7-4990-8905-462aa29bab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.547543 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed8445-a0e9-4c1b-9231-0bc5f7d68bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.547977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7505b8-dec7-4990-8905-462aa29bab9f admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.548156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed8445-a0e9-4c1b-9231-0bc5f7d68bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.548270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7505b8-dec7-4990-8905-462aa29bab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.548427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed8445-a0e9-4c1b-9231-0bc5f7d68bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.548548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7505b8-dec7-4990-8905-462aa29bab9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.548796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed8445-a0e9-4c1b-9231-0bc5f7d68bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.549146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7505b8-dec7-4990-8905-462aa29bab9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.549466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed8445-a0e9-4c1b-9231-0bc5f7d68bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.551072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7505b8-dec7-4990-8905-462aa29bab9f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.553264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed8445-a0e9-4c1b-9231-0bc5f7d68bd0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.679199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:18.686606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 781/1574] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.686606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed8445-a0e9-4c1b-9231-0bc5f7d68bd0 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.688684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 794/1575] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.690096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7505b8-dec7-4990-8905-462aa29bab9f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.694949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed8445-a0e9-4c1b-9231-0bc5f7d68bd0 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.752729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f8451-cedb-44a4-a158-ab3c86372c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.752942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7505b8-dec7-4990-8905-462aa29bab9f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.753257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8451-cedb-44a4-a158-ab3c86372c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.753551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8451-cedb-44a4-a158-ab3c86372c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.753854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8451-cedb-44a4-a158-ab3c86372c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.754476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8451-cedb-44a4-a158-ab3c86372c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.756555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8451-cedb-44a4-a158-ab3c86372c0d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.757600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c9f8-318e-4c4a-a890-36e24589600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.758252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c9f8-318e-4c4a-a890-36e24589600e admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.758529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c9f8-318e-4c4a-a890-36e24589600e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.758805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302c9f8-318e-4c4a-a890-36e24589600e admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.759663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302c9f8-318e-4c4a-a890-36e24589600e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.761737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302c9f8-318e-4c4a-a890-36e24589600e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.864336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 782/1576] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.864336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f8451-cedb-44a4-a158-ab3c86372c0d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.871904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f8451-cedb-44a4-a158-ab3c86372c0d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.876601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d524-0460-476c-b648-3f37a3fd212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.877818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d524-0460-476c-b648-3f37a3fd212c admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.878100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d524-0460-476c-b648-3f37a3fd212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.878374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19d524-0460-476c-b648-3f37a3fd212c admin admin] PATH_INFO: `/v3/projects/21914d0039c64691bc3f0df327ac6643/users/64b85c9b98734971bfe8ad73f472a0bd/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.888897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 795/1577] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.891845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c9f8-318e-4c4a-a890-36e24589600e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.894970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d524-0460-476c-b648-3f37a3fd212c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21914d0039c64691bc3f0df327ac6643, user_id=64b85c9b98734971bfe8ad73f472a0bd, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.897632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19d524-0460-476c-b648-3f37a3fd212c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.899647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302c9f8-318e-4c4a-a890-36e24589600e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:18.904275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e999-d5ea-4780-83a9-f72a3d144fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:18.904868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e999-d5ea-4780-83a9-f72a3d144fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:18.905149 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e999-d5ea-4780-83a9-f72a3d144fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:18.905421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e999-d5ea-4780-83a9-f72a3d144fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:18.906077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29e999-d5ea-4780-83a9-f72a3d144fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:18.908715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29e999-d5ea-4780-83a9-f72a3d144fbd admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:18.969461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 783/1578] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:18 2022] PUT /identity/v3/projects/21914d0039c64691bc3f0df327ac6643/users/64b85c9b98734971bfe8ad73f472a0bd/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:18.970312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d524-0460-476c-b648-3f37a3fd212c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:18.991435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 796/1579] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:18.992863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e999-d5ea-4780-83a9-f72a3d144fbd admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.036854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19d524-0460-476c-b648-3f37a3fd212c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.054491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e999-d5ea-4780-83a9-f72a3d144fbd admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.059683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772bf3-6987-4dc5-b73d-4326a1aa8378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.060307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772bf3-6987-4dc5-b73d-4326a1aa8378 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.060589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772bf3-6987-4dc5-b73d-4326a1aa8378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.060888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772bf3-6987-4dc5-b73d-4326a1aa8378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.061537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772bf3-6987-4dc5-b73d-4326a1aa8378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.063214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772bf3-6987-4dc5-b73d-4326a1aa8378 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.064318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:19.073267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 797/1580] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.074116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772bf3-6987-4dc5-b73d-4326a1aa8378 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.083882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772bf3-6987-4dc5-b73d-4326a1aa8378 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.088615 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff6fca-49c4-4efe-8a62-c01908eac239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.089233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff6fca-49c4-4efe-8a62-c01908eac239 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.089518 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff6fca-49c4-4efe-8a62-c01908eac239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.089825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff6fca-49c4-4efe-8a62-c01908eac239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.090493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff6fca-49c4-4efe-8a62-c01908eac239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.092185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff6fca-49c4-4efe-8a62-c01908eac239 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.095204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a13fa-7b3d-4190-bb92-2caacc58f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.096320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a13fa-7b3d-4190-bb92-2caacc58f565 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.096599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a13fa-7b3d-4190-bb92-2caacc58f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.096870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a13fa-7b3d-4190-bb92-2caacc58f565 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.097493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a13fa-7b3d-4190-bb92-2caacc58f565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.099423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a13fa-7b3d-4190-bb92-2caacc58f565 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.102813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 798/1581] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.103597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff6fca-49c4-4efe-8a62-c01908eac239 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.115114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff6fca-49c4-4efe-8a62-c01908eac239 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.123783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9ea33-de9f-43bf-be27-1d962a98cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.123783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9ea33-de9f-43bf-be27-1d962a98cc06 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.123783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9ea33-de9f-43bf-be27-1d962a98cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.123783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9ea33-de9f-43bf-be27-1d962a98cc06 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.124174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9ea33-de9f-43bf-be27-1d962a98cc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.124174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9ea33-de9f-43bf-be27-1d962a98cc06 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.212396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 784/1582] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:18 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:19.213230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a13fa-7b3d-4190-bb92-2caacc58f565 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.221882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 799/1583] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:19 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:19.222831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a13fa-7b3d-4190-bb92-2caacc58f565 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.223244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9ea33-de9f-43bf-be27-1d962a98cc06 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.228480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccc894-a6ef-4346-bad1-217f42ae9c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.229084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccc894-a6ef-4346-bad1-217f42ae9c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.229369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccc894-a6ef-4346-bad1-217f42ae9c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.229669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccc894-a6ef-4346-bad1-217f42ae9c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.230317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccc894-a6ef-4346-bad1-217f42ae9c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.231911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccc894-a6ef-4346-bad1-217f42ae9c4e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.232747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9ea33-de9f-43bf-be27-1d962a98cc06 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.237355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f782f-9b22-4169-ae21-eadf4a14615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.237961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f782f-9b22-4169-ae21-eadf4a14615d admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.238241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f782f-9b22-4169-ae21-eadf4a14615d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.238510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f782f-9b22-4169-ae21-eadf4a14615d admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.239139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f782f-9b22-4169-ae21-eadf4a14615d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.240695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f782f-9b22-4169-ae21-eadf4a14615d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.243287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 785/1584] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.246809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25221a28-b859-4b5d-ae62-2826cb43ca7c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.246809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25221a28-b859-4b5d-ae62-2826cb43ca7c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.246809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25221a28-b859-4b5d-ae62-2826cb43ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.250895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 800/1585] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.252420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f782f-9b22-4169-ae21-eadf4a14615d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.262817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f782f-9b22-4169-ae21-eadf4a14615d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.267463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d7d5-71dd-42cb-a6a8-63aafaa07bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.268652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d7d5-71dd-42cb-a6a8-63aafaa07bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.268935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d7d5-71dd-42cb-a6a8-63aafaa07bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.269238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d7d5-71dd-42cb-a6a8-63aafaa07bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.269885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d7d5-71dd-42cb-a6a8-63aafaa07bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.271797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d7d5-71dd-42cb-a6a8-63aafaa07bc7 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.273587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-25221a28-b859-4b5d-ae62-2826cb43ca7c None None] MFA Rules not processed for user `64b85c9b98734971bfe8ad73f472a0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:19.274808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-25221a28-b859-4b5d-ae62-2826cb43ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:19.338533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 786/1586] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:19.339635 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25221a28-b859-4b5d-ae62-2826cb43ca7c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.349726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25221a28-b859-4b5d-ae62-2826cb43ca7c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.354305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc9526-0eec-400d-aee3-9fcb4c649634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.354890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc9526-0eec-400d-aee3-9fcb4c649634 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.355172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc9526-0eec-400d-aee3-9fcb4c649634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.355446 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc9526-0eec-400d-aee3-9fcb4c649634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.356183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc9526-0eec-400d-aee3-9fcb4c649634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.357783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc9526-0eec-400d-aee3-9fcb4c649634 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.369510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 787/1587] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.370419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc9526-0eec-400d-aee3-9fcb4c649634 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.381443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc9526-0eec-400d-aee3-9fcb4c649634 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.387011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e08b-3d8c-4909-b9b8-1ab4360c22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.387840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e08b-3d8c-4909-b9b8-1ab4360c22c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.387993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e08b-3d8c-4909-b9b8-1ab4360c22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.388155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e08b-3d8c-4909-b9b8-1ab4360c22c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.388800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734e08b-3d8c-4909-b9b8-1ab4360c22c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.390429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734e08b-3d8c-4909-b9b8-1ab4360c22c2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.400343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 801/1588] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:19 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:19.400343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d7d5-71dd-42cb-a6a8-63aafaa07bc7 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.401059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 788/1589] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.401912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e08b-3d8c-4909-b9b8-1ab4360c22c2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.407339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d7d5-71dd-42cb-a6a8-63aafaa07bc7 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.411686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e08b-3d8c-4909-b9b8-1ab4360c22c2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.412152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210e335-a31a-4008-938d-cc2872bbfb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.412755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210e335-a31a-4008-938d-cc2872bbfb85 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.413033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210e335-a31a-4008-938d-cc2872bbfb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.413305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210e335-a31a-4008-938d-cc2872bbfb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.414005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210e335-a31a-4008-938d-cc2872bbfb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.415619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210e335-a31a-4008-938d-cc2872bbfb85 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.416362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a72d3-ebdc-4097-89c0-9f7a4c9fa089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.416934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a72d3-ebdc-4097-89c0-9f7a4c9fa089 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.417197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:19.417335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a72d3-ebdc-4097-89c0-9f7a4c9fa089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.417457 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a72d3-ebdc-4097-89c0-9f7a4c9fa089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.418123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a72d3-ebdc-4097-89c0-9f7a4c9fa089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.419689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a72d3-ebdc-4097-89c0-9f7a4c9fa089 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.433157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 789/1590] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.444039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 802/1591] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.444150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a72d3-ebdc-4097-89c0-9f7a4c9fa089 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.444252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210e335-a31a-4008-938d-cc2872bbfb85 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.444252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210e335-a31a-4008-938d-cc2872bbfb85 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.447086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a72d3-ebdc-4097-89c0-9f7a4c9fa089 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.448861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ee675-2b99-4e80-bc0e-180d69d71082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.449460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ee675-2b99-4e80-bc0e-180d69d71082 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.449806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ee675-2b99-4e80-bc0e-180d69d71082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.450084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ee675-2b99-4e80-bc0e-180d69d71082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.450784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ee675-2b99-4e80-bc0e-180d69d71082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.451800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585c5fa-2153-49f8-9763-881fb3682af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.452415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ee675-2b99-4e80-bc0e-180d69d71082 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.452541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c5fa-2153-49f8-9763-881fb3682af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.452755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c5fa-2153-49f8-9763-881fb3682af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.453026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585c5fa-2153-49f8-9763-881fb3682af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.453688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585c5fa-2153-49f8-9763-881fb3682af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.455400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585c5fa-2153-49f8-9763-881fb3682af6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.462935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 803/1592] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.463905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ee675-2b99-4e80-bc0e-180d69d71082 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.468408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 790/1593] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.468408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383f6e-d033-47a8-9ee3-87cd37a04cc9 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.468408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383f6e-d033-47a8-9ee3-87cd37a04cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.468408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383f6e-d033-47a8-9ee3-87cd37a04cc9 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.468831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 791/1594] 10.222.0.61 () {54 vars in 962 bytes} [Tue Aug 23 16:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:34:19.469380 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79383f6e-d033-47a8-9ee3-87cd37a04cc9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.475151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ee675-2b99-4e80-bc0e-180d69d71082 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.479913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.480557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.480837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.481218 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] PATH_INFO: `/v3/projects/2c15c6981fdc49d587b83331ad591385/users/e14897169009484aa4b469130ebc7cb5/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.482670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79383f6e-d033-47a8-9ee3-87cd37a04cc9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.487664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bf6df-567d-4a63-a254-75370845b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.488243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bf6df-567d-4a63-a254-75370845b6df admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.488527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bf6df-567d-4a63-a254-75370845b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.488801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bf6df-567d-4a63-a254-75370845b6df admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.489438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bf6df-567d-4a63-a254-75370845b6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.491057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bf6df-567d-4a63-a254-75370845b6df admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.496296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c15c6981fdc49d587b83331ad591385, user_id=e14897169009484aa4b469130ebc7cb5, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.497387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING py.warnings [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:34:19.497387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: warnings.warn(msg) Aug 23 16:34:19.497387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: Aug 23 16:34:19.499504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.500961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 792/1595] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.501770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bf6df-567d-4a63-a254-75370845b6df admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.512185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bf6df-567d-4a63-a254-75370845b6df admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.516701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeace4-b2a6-4187-bec7-ee473632d261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.517325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeace4-b2a6-4187-bec7-ee473632d261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.517659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeace4-b2a6-4187-bec7-ee473632d261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.517939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafeace4-b2a6-4187-bec7-ee473632d261 admin admin] PATH_INFO: `/v3/projects/4eb4d34120324f098decdeee786839a1/users/ab934520bd5e4a5e9c82fdfacbf99f5c/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.533227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafeace4-b2a6-4187-bec7-ee473632d261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb4d34120324f098decdeee786839a1, user_id=ab934520bd5e4a5e9c82fdfacbf99f5c, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.535917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafeace4-b2a6-4187-bec7-ee473632d261 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.577437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 804/1596] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:19 2022] PUT /identity/v3/projects/2c15c6981fdc49d587b83331ad591385/users/e14897169009484aa4b469130ebc7cb5/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:19.578386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.637652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850621f-9cf0-475c-bfb5-709b5b51b669 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.642206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757f8c-8ce4-424b-85bc-73d2449fae27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.642865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757f8c-8ce4-424b-85bc-73d2449fae27 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.643109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757f8c-8ce4-424b-85bc-73d2449fae27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.643384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757f8c-8ce4-424b-85bc-73d2449fae27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.644018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d757f8c-8ce4-424b-85bc-73d2449fae27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.645631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d757f8c-8ce4-424b-85bc-73d2449fae27 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.655027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 805/1597] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.655875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757f8c-8ce4-424b-85bc-73d2449fae27 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.665723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757f8c-8ce4-424b-85bc-73d2449fae27 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.670294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5dc6-a682-4255-b307-119c4e35510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.670863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5dc6-a682-4255-b307-119c4e35510d admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.671145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5dc6-a682-4255-b307-119c4e35510d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.671420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e5dc6-a682-4255-b307-119c4e35510d admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.672035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5dc6-a682-4255-b307-119c4e35510d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.673677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e5dc6-a682-4255-b307-119c4e35510d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.676358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 793/1598] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:19 2022] PUT /identity/v3/projects/4eb4d34120324f098decdeee786839a1/users/ab934520bd5e4a5e9c82fdfacbf99f5c/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:19.677202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeace4-b2a6-4187-bec7-ee473632d261 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.685667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 806/1599] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:19.689790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5dc6-a682-4255-b307-119c4e35510d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.696194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e5dc6-a682-4255-b307-119c4e35510d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.699476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:19.741669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafeace4-b2a6-4187-bec7-ee473632d261 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:19.746943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b8172-fdaa-43b0-bccb-7957f85f9204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.747633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b8172-fdaa-43b0-bccb-7957f85f9204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.747915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b8172-fdaa-43b0-bccb-7957f85f9204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.748183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b8172-fdaa-43b0-bccb-7957f85f9204 admin admin] PATH_INFO: `/v3/projects/24fa4a5370b446f58b2461535f16e9d4/users/7406a426e16a415e9c1f457f58a0871b/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.753430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c461d-2712-4f1e-a653-0a0168c44220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:19.754132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c461d-2712-4f1e-a653-0a0168c44220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.754416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c461d-2712-4f1e-a653-0a0168c44220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.754694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c461d-2712-4f1e-a653-0a0168c44220 admin admin] PATH_INFO: `/v3/projects/4caab1ba61954fa58c5813f19117fb6a/users/0a91a3b1d4294b71b5f0e69afe8b2ac4/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.762965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b8172-fdaa-43b0-bccb-7957f85f9204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fa4a5370b446f58b2461535f16e9d4, user_id=7406a426e16a415e9c1f457f58a0871b, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.765750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b8172-fdaa-43b0-bccb-7957f85f9204 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.769427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c461d-2712-4f1e-a653-0a0168c44220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4caab1ba61954fa58c5813f19117fb6a, user_id=0a91a3b1d4294b71b5f0e69afe8b2ac4, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:19.772161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c461d-2712-4f1e-a653-0a0168c44220 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:19.901800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 794/1600] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:19 2022] PUT /identity/v3/projects/24fa4a5370b446f58b2461535f16e9d4/users/7406a426e16a415e9c1f457f58a0871b/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:19.903091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e11b5-4305-4293-9918-0a11240b8575 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:19.903325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e11b5-4305-4293-9918-0a11240b8575 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:19.903597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e11b5-4305-4293-9918-0a11240b8575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:19.930558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 807/1601] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:19 2022] PUT /identity/v3/projects/4caab1ba61954fa58c5813f19117fb6a/users/0a91a3b1d4294b71b5f0e69afe8b2ac4/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:19.931398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c461d-2712-4f1e-a653-0a0168c44220 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:19.947814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fa7e11b5-4305-4293-9918-0a11240b8575 None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:19.949061 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fa7e11b5-4305-4293-9918-0a11240b8575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:19.970313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:19.996467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c461d-2712-4f1e-a653-0a0168c44220 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.001189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5582f-ba0a-4a04-b038-25655447a257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.001911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5582f-ba0a-4a04-b038-25655447a257 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.002251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5582f-ba0a-4a04-b038-25655447a257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.002595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5582f-ba0a-4a04-b038-25655447a257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.003305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5582f-ba0a-4a04-b038-25655447a257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.004978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5582f-ba0a-4a04-b038-25655447a257 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:20.015214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 808/1602] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:20.019094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 795/1603] 10.222.0.61 () {58 vars in 1059 bytes} [Tue Aug 23 16:34:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.019241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bd947-3418-429d-a35b-d961b3487746 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.019241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bd947-3418-429d-a35b-d961b3487746 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.019558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e11b5-4305-4293-9918-0a11240b8575 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.019663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bd947-3418-429d-a35b-d961b3487746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.030922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e11b5-4305-4293-9918-0a11240b8575 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.036253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc20bd6-07c0-4094-99f0-bbf2c8f456cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.036923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc20bd6-07c0-4094-99f0-bbf2c8f456cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.037206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc20bd6-07c0-4094-99f0-bbf2c8f456cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.037481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc20bd6-07c0-4094-99f0-bbf2c8f456cc admin admin] PATH_INFO: `/v3/projects/ccf8670883ee40d8b08788c6e2f1a7d0/users/98c81b8a6a7b4c5ab328d9095ef5b1d1/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.051259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b37bd947-3418-429d-a35b-d961b3487746 None None] MFA Rules not processed for user `e14897169009484aa4b469130ebc7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:20.052502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b37bd947-3418-429d-a35b-d961b3487746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:20.053064 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc20bd6-07c0-4094-99f0-bbf2c8f456cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf8670883ee40d8b08788c6e2f1a7d0, user_id=98c81b8a6a7b4c5ab328d9095ef5b1d1, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.055959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc20bd6-07c0-4094-99f0-bbf2c8f456cc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:20.119081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 809/1604] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.120893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df18f50-3a2e-4599-b72c-1e2fd51dc577 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.121227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df18f50-3a2e-4599-b72c-1e2fd51dc577 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.121478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df18f50-3a2e-4599-b72c-1e2fd51dc577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.132157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 796/1605] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:20 2022] PUT /identity/v3/projects/ccf8670883ee40d8b08788c6e2f1a7d0/users/98c81b8a6a7b4c5ab328d9095ef5b1d1/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:20.137165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc20bd6-07c0-4094-99f0-bbf2c8f456cc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.145472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-3df18f50-3a2e-4599-b72c-1e2fd51dc577 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:20.146801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3df18f50-3a2e-4599-b72c-1e2fd51dc577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:20.204679 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:20.212015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc20bd6-07c0-4094-99f0-bbf2c8f456cc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.217700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 810/1606] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.217700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa671e-12b2-4ebb-8c3d-477c8f120f8a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.217700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa671e-12b2-4ebb-8c3d-477c8f120f8a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.217700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa671e-12b2-4ebb-8c3d-477c8f120f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.224183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a4d7-70d4-43cf-9eaa-5dfbd54c5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.224183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a4d7-70d4-43cf-9eaa-5dfbd54c5d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.224183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a4d7-70d4-43cf-9eaa-5dfbd54c5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.224183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a4d7-70d4-43cf-9eaa-5dfbd54c5d82 admin admin] PATH_INFO: `/v3/projects/3ce9190db34f4b40a81e9605cb05ae97/users/f2d6e1a8b75547468e2294bff8274c33/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.238137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-50fa671e-12b2-4ebb-8c3d-477c8f120f8a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:20.239436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-50fa671e-12b2-4ebb-8c3d-477c8f120f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:20.240992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6a4d7-70d4-43cf-9eaa-5dfbd54c5d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce9190db34f4b40a81e9605cb05ae97, user_id=f2d6e1a8b75547468e2294bff8274c33, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.243868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6a4d7-70d4-43cf-9eaa-5dfbd54c5d82 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:20.247095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 811/1607] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.248400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b6de-3abe-4c5b-a6ed-8f0f13a88548 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.248685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b6de-3abe-4c5b-a6ed-8f0f13a88548 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.248954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b6de-3abe-4c5b-a6ed-8f0f13a88548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.279092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7cd1b6de-3abe-4c5b-a6ed-8f0f13a88548 None None] MFA Rules not processed for user `0a91a3b1d4294b71b5f0e69afe8b2ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:20.280297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7cd1b6de-3abe-4c5b-a6ed-8f0f13a88548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:20.318923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:20.329440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 797/1608] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:20 2022] PUT /identity/v3/projects/3ce9190db34f4b40a81e9605cb05ae97/users/f2d6e1a8b75547468e2294bff8274c33/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:20.330186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a4d7-70d4-43cf-9eaa-5dfbd54c5d82 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.347655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 812/1609] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.348507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b6de-3abe-4c5b-a6ed-8f0f13a88548 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.395077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a4d7-70d4-43cf-9eaa-5dfbd54c5d82 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.400105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358382da-7fcd-4901-998f-8ba9e49475e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.400766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358382da-7fcd-4901-998f-8ba9e49475e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.401046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358382da-7fcd-4901-998f-8ba9e49475e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.401320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358382da-7fcd-4901-998f-8ba9e49475e0 admin admin] PATH_INFO: `/v3/projects/a7df6c3f1fad4357bac37b72661d549c/users/6f52478f18824ed2bd2cd78eb41b88ca/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.416639 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358382da-7fcd-4901-998f-8ba9e49475e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7df6c3f1fad4357bac37b72661d549c, user_id=6f52478f18824ed2bd2cd78eb41b88ca, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.419370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358382da-7fcd-4901-998f-8ba9e49475e0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:20.420483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b6de-3abe-4c5b-a6ed-8f0f13a88548 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.482764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40e8ef-1d2e-4435-ac87-aacc4b03ddfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.483377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40e8ef-1d2e-4435-ac87-aacc4b03ddfc service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.483662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40e8ef-1d2e-4435-ac87-aacc4b03ddfc service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.483936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40e8ef-1d2e-4435-ac87-aacc4b03ddfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.522381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 798/1610] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:20 2022] PUT /identity/v3/projects/a7df6c3f1fad4357bac37b72661d549c/users/6f52478f18824ed2bd2cd78eb41b88ca/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:20.523740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a2181-9911-4a83-af5c-3fd4d03bfec0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.524027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a2181-9911-4a83-af5c-3fd4d03bfec0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.524299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a2181-9911-4a83-af5c-3fd4d03bfec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.544452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-141a2181-9911-4a83-af5c-3fd4d03bfec0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:20.545702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-141a2181-9911-4a83-af5c-3fd4d03bfec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:20.548388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40e8ef-1d2e-4435-ac87-aacc4b03ddfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.550287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40e8ef-1d2e-4435-ac87-aacc4b03ddfc service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:20.560947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 813/1611] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:20.562256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685b2bd-d402-4fe1-a1d4-afb1371ba504 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.562543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685b2bd-d402-4fe1-a1d4-afb1371ba504 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.562813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685b2bd-d402-4fe1-a1d4-afb1371ba504 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.564292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 814/1612] 10.222.0.61 () {54 vars in 962 bytes} [Tue Aug 23 16:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:34:20.565287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685b2bd-d402-4fe1-a1d4-afb1371ba504 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.581069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:20.613809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 799/1613] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.614785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a2181-9911-4a83-af5c-3fd4d03bfec0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.642173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685b2bd-d402-4fe1-a1d4-afb1371ba504 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.647188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555f6c9-581f-420d-9196-f774ef8d08e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.648152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f6c9-581f-420d-9196-f774ef8d08e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.648641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f6c9-581f-420d-9196-f774ef8d08e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.649091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555f6c9-581f-420d-9196-f774ef8d08e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.659800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f6c9-581f-420d-9196-f774ef8d08e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.661307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555f6c9-581f-420d-9196-f774ef8d08e5 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:20.674238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 815/1614] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:20.675523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b188-239c-41d7-9cfe-2f9e3be38b91 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.675808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b188-239c-41d7-9cfe-2f9e3be38b91 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.676151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b188-239c-41d7-9cfe-2f9e3be38b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.680173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a2181-9911-4a83-af5c-3fd4d03bfec0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.683853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe32d-dc6f-44e6-9283-b6363df89d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.684461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe32d-dc6f-44e6-9283-b6363df89d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.684737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe32d-dc6f-44e6-9283-b6363df89d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.685004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe32d-dc6f-44e6-9283-b6363df89d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.695464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfe32d-dc6f-44e6-9283-b6363df89d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.696911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfe32d-dc6f-44e6-9283-b6363df89d5b service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:20.698017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-fb57b188-239c-41d7-9cfe-2f9e3be38b91 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:20.699430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fb57b188-239c-41d7-9cfe-2f9e3be38b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:20.707574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 800/1615] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:20.708626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe32d-dc6f-44e6-9283-b6363df89d5b service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.709779 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 816/1616] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.711205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc25e1-ae87-449e-94ed-9691e8d92650 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.711650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc25e1-ae87-449e-94ed-9691e8d92650 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.712079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc25e1-ae87-449e-94ed-9691e8d92650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.721461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:20.725651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe32d-dc6f-44e6-9283-b6363df89d5b service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.731456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea2098-1d3d-4c76-9f9e-50eb95ca363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.731709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea2098-1d3d-4c76-9f9e-50eb95ca363a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.732070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea2098-1d3d-4c76-9f9e-50eb95ca363a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.732346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea2098-1d3d-4c76-9f9e-50eb95ca363a admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.733076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea2098-1d3d-4c76-9f9e-50eb95ca363a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.735317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea2098-1d3d-4c76-9f9e-50eb95ca363a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:20.749774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-befc25e1-ae87-449e-94ed-9691e8d92650 None None] MFA Rules not processed for user `6f52478f18824ed2bd2cd78eb41b88ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:20.751276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-befc25e1-ae87-449e-94ed-9691e8d92650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:20.823725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 801/1617] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:20.825025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4204d-a7e2-4e36-aaac-f1296f1d7f9b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.825376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4204d-a7e2-4e36-aaac-f1296f1d7f9b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.825694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4204d-a7e2-4e36-aaac-f1296f1d7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.846747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 817/1618] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.846747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc25e1-ae87-449e-94ed-9691e8d92650 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.855043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc25e1-ae87-449e-94ed-9691e8d92650 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.862711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2ca4204d-a7e2-4e36-aaac-f1296f1d7f9b None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:20.863974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2ca4204d-a7e2-4e36-aaac-f1296f1d7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:20.915401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8981d-b699-4f25-b289-1935987aef6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.916860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8981d-b699-4f25-b289-1935987aef6e service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.917763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8981d-b699-4f25-b289-1935987aef6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.918268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8981d-b699-4f25-b289-1935987aef6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.942429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 802/1619] 10.222.0.61 () {58 vars in 1059 bytes} [Tue Aug 23 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:20.943372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4204d-a7e2-4e36-aaac-f1296f1d7f9b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:20.952990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4204d-a7e2-4e36-aaac-f1296f1d7f9b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:20.957398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76700f-1876-419e-b776-cce0eabf645d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:20.958173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76700f-1876-419e-b776-cce0eabf645d service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:20.958441 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76700f-1876-419e-b776-cce0eabf645d service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:20.961032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76700f-1876-419e-b776-cce0eabf645d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:20.979948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:20.994256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8981d-b699-4f25-b289-1935987aef6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:20.996146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf8981d-b699-4f25-b289-1935987aef6e service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.006533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 818/1620] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:21.007884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda20ec-47c6-4209-8459-e13df709a58a None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.008181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda20ec-47c6-4209-8459-e13df709a58a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.008534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda20ec-47c6-4209-8459-e13df709a58a None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.010094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 819/1621] 10.222.0.61 () {54 vars in 912 bytes} [Tue Aug 23 16:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:34:21.010791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda20ec-47c6-4209-8459-e13df709a58a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:21.024553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda20ec-47c6-4209-8459-e13df709a58a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:21.033354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76700f-1876-419e-b776-cce0eabf645d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.034985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76700f-1876-419e-b776-cce0eabf645d service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.035754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d93c67-662b-45af-a424-940b9aebe81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:21.036367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d93c67-662b-45af-a424-940b9aebe81a admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.036678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d93c67-662b-45af-a424-940b9aebe81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.036951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d93c67-662b-45af-a424-940b9aebe81a admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.037576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d93c67-662b-45af-a424-940b9aebe81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.039657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d93c67-662b-45af-a424-940b9aebe81a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.045795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 803/1622] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:21.053636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76700f-1876-419e-b776-cce0eabf645d service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:21.113041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76700f-1876-419e-b776-cce0eabf645d service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:21.116794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c8ef4-9ed5-4212-9034-bd7e283936b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:21.117229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c8ef4-9ed5-4212-9034-bd7e283936b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.117523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c8ef4-9ed5-4212-9034-bd7e283936b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.117808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c8ef4-9ed5-4212-9034-bd7e283936b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.142182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:21.170373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 820/1623] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:21 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:21.172934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d93c67-662b-45af-a424-940b9aebe81a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:21.192416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d93c67-662b-45af-a424-940b9aebe81a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:21.198295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c8ef4-9ed5-4212-9034-bd7e283936b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.199807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c8ef4-9ed5-4212-9034-bd7e283936b1 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.204162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016b8b-a3dd-45b3-8754-1c6e9151faf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:21.205844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016b8b-a3dd-45b3-8754-1c6e9151faf4 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.206522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016b8b-a3dd-45b3-8754-1c6e9151faf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.207223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc016b8b-a3dd-45b3-8754-1c6e9151faf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.210731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 804/1624] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:21.212800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90855f4-bf7e-4fcf-b7ed-f75f021c7bbd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.213199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90855f4-bf7e-4fcf-b7ed-f75f021c7bbd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.213812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90855f4-bf7e-4fcf-b7ed-f75f021c7bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.237757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d90855f4-bf7e-4fcf-b7ed-f75f021c7bbd None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:21.239706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d90855f4-bf7e-4fcf-b7ed-f75f021c7bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:21.252330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 805/1625] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:34:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:21.253308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90855f4-bf7e-4fcf-b7ed-f75f021c7bbd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:21.273039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90855f4-bf7e-4fcf-b7ed-f75f021c7bbd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:21.278313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c243c8-6778-4a73-91a6-64dc52dcb1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:21.279055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c243c8-6778-4a73-91a6-64dc52dcb1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.279476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c243c8-6778-4a73-91a6-64dc52dcb1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.279845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c243c8-6778-4a73-91a6-64dc52dcb1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.280644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c243c8-6778-4a73-91a6-64dc52dcb1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.282688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c243c8-6778-4a73-91a6-64dc52dcb1d2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.298842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 806/1626] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:21.300437 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c243c8-6778-4a73-91a6-64dc52dcb1d2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:21.313273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc016b8b-a3dd-45b3-8754-1c6e9151faf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.313922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c243c8-6778-4a73-91a6-64dc52dcb1d2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:21.315849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc016b8b-a3dd-45b3-8754-1c6e9151faf4 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.318150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93ea6f-e426-47f5-b4d9-29c58de55b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:21.318911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93ea6f-e426-47f5-b4d9-29c58de55b9b service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.319530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93ea6f-e426-47f5-b4d9-29c58de55b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.319909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93ea6f-e426-47f5-b4d9-29c58de55b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.327282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 821/1627] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:21.328401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016b8b-a3dd-45b3-8754-1c6e9151faf4 service nova] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:21.340216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc016b8b-a3dd-45b3-8754-1c6e9151faf4 service nova] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:21.345175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e7adb-26d7-4037-85d1-d0db5c7983ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:21.347069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7adb-26d7-4037-85d1-d0db5c7983ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.347351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7adb-26d7-4037-85d1-d0db5c7983ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.347621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7adb-26d7-4037-85d1-d0db5c7983ab admin admin] PATH_INFO: `/v3/projects/2650b0a0245b4e4790d03f2cdb2d9d14/users/b527417933364862b4b9a2489fede78e/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.354180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93ea6f-e426-47f5-b4d9-29c58de55b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.359289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93ea6f-e426-47f5-b4d9-29c58de55b9b service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.366390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e7adb-26d7-4037-85d1-d0db5c7983ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2650b0a0245b4e4790d03f2cdb2d9d14, user_id=b527417933364862b4b9a2489fede78e, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.369508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e7adb-26d7-4037-85d1-d0db5c7983ab admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.406050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 807/1628] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:21.493383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 822/1629] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:21 2022] PUT /identity/v3/projects/2650b0a0245b4e4790d03f2cdb2d9d14/users/b527417933364862b4b9a2489fede78e/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:21.497261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93ea6f-e426-47f5-b4d9-29c58de55b9b service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:21.519560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93ea6f-e426-47f5-b4d9-29c58de55b9b service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:21.647630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93583265-1665-4db4-a712-41dcd0b5604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:21.648483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583265-1665-4db4-a712-41dcd0b5604b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.648770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583265-1665-4db4-a712-41dcd0b5604b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.649043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583265-1665-4db4-a712-41dcd0b5604b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.649737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93583265-1665-4db4-a712-41dcd0b5604b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.657692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93583265-1665-4db4-a712-41dcd0b5604b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.676268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e7adb-26d7-4037-85d1-d0db5c7983ab admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:21.691939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e7adb-26d7-4037-85d1-d0db5c7983ab admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:21.693029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 808/1630] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:21.700841 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1bf40-6da3-4ae7-a9e3-8b8f36a825d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:21.701445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1bf40-6da3-4ae7-a9e3-8b8f36a825d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.701759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1bf40-6da3-4ae7-a9e3-8b8f36a825d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.702033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1bf40-6da3-4ae7-a9e3-8b8f36a825d2 admin admin] PATH_INFO: `/v3/projects/2650b0a0245b4e4790d03f2cdb2d9d14/users/b527417933364862b4b9a2489fede78e/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.710707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1bf40-6da3-4ae7-a9e3-8b8f36a825d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2650b0a0245b4e4790d03f2cdb2d9d14, user_id=b527417933364862b4b9a2489fede78e, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:21.713386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1bf40-6da3-4ae7-a9e3-8b8f36a825d2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:21.747073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298798d-436b-4dbd-a774-a53aae52b923 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.747269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298798d-436b-4dbd-a774-a53aae52b923 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.747550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298798d-436b-4dbd-a774-a53aae52b923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.750289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 823/1631] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:21 2022] PUT /identity/v3/projects/2650b0a0245b4e4790d03f2cdb2d9d14/users/b527417933364862b4b9a2489fede78e/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:21.805075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a298798d-436b-4dbd-a774-a53aae52b923 None None] MFA Rules not processed for user `b527417933364862b4b9a2489fede78e`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:21.808887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7296cae-9ed1-4742-9f11-2455371f9d06 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.809257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7296cae-9ed1-4742-9f11-2455371f9d06 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.809481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7296cae-9ed1-4742-9f11-2455371f9d06 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.811129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 824/1632] 10.222.0.61 () {54 vars in 912 bytes} [Tue Aug 23 16:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:34:21.815012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a298798d-436b-4dbd-a774-a53aae52b923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:21.816736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd934ac-f51b-4d63-8e13-12bbe56fb31f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:21.817419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd934ac-f51b-4d63-8e13-12bbe56fb31f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:21.817540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd934ac-f51b-4d63-8e13-12bbe56fb31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:21.858789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ebd934ac-f51b-4d63-8e13-12bbe56fb31f None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:21.862386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ebd934ac-f51b-4d63-8e13-12bbe56fb31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:21.976683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 809/1633] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:22.005368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 825/1634] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:34:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:34:22.379616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298798d-436b-4dbd-a774-a53aae52b923 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:22.397970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:22.454975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298798d-436b-4dbd-a774-a53aae52b923 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:22.459373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687c837-b519-416f-a50a-2226f66de4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:22.459994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687c837-b519-416f-a50a-2226f66de4bc service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:22.460275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687c837-b519-416f-a50a-2226f66de4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:22.460550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687c837-b519-416f-a50a-2226f66de4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:22.471193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687c837-b519-416f-a50a-2226f66de4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:22.472683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687c837-b519-416f-a50a-2226f66de4bc service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:22.485653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 810/1635] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:22.570662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd934ac-f51b-4d63-8e13-12bbe56fb31f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:22.580613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd934ac-f51b-4d63-8e13-12bbe56fb31f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:22.584559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700d53e-9112-4e48-a665-3bdc9a5c04e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:22.585273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d53e-9112-4e48-a665-3bdc9a5c04e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:22.585659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d53e-9112-4e48-a665-3bdc9a5c04e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:22.586036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700d53e-9112-4e48-a665-3bdc9a5c04e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:22.600566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700d53e-9112-4e48-a665-3bdc9a5c04e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:22.603144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700d53e-9112-4e48-a665-3bdc9a5c04e8 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:22.620121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 826/1636] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:24.186128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687c837-b519-416f-a50a-2226f66de4bc service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:24.356654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687c837-b519-416f-a50a-2226f66de4bc service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:24.370337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:24.375632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:24.375632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:24.375632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] PATH_INFO: `/v3/users/0a91a3b1d4294b71b5f0e69afe8b2ac4` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:24.376004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a91a3b1d4294b71b5f0e69afe8b2ac4)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:24.379264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:24.960929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a91a3b1d4294b71b5f0e69afe8b2ac4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:24.995977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a91a3b1d4294b71b5f0e69afe8b2ac4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:24.997162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a91a3b1d4294b71b5f0e69afe8b2ac4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:24.999462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a91a3b1d4294b71b5f0e69afe8b2ac4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:25.045928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a91a3b1d4294b71b5f0e69afe8b2ac4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:25.196609 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 811/1637] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:24 2022] DELETE /identity/v3/users/0a91a3b1d4294b71b5f0e69afe8b2ac4 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:25.201589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00db38-3319-4f93-914c-ca616a65b7c9 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:25.202522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00db38-3319-4f93-914c-ca616a65b7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:25.202979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00db38-3319-4f93-914c-ca616a65b7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:25.247799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2e00db38-3319-4f93-914c-ca616a65b7c9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:25.250343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2e00db38-3319-4f93-914c-ca616a65b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:25.273501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:25.489203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 827/1638] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:25.837384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:25.838870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:25.907212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:25.932277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d3d7d-4050-4199-be22-f912297926b9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:25.944980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:25.945643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:25.946251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:25.946535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:25.978866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:25.980924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:26.018416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 812/1639] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:27.173298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00db38-3319-4f93-914c-ca616a65b7c9 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:27.176042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2e00db38-3319-4f93-914c-ca616a65b7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:27.204465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00db38-3319-4f93-914c-ca616a65b7c9 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:27.219581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:27.224884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:27.225190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:27.225465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] PATH_INFO: `/v3/users/e14897169009484aa4b469130ebc7cb5` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:27.229972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14897169009484aa4b469130ebc7cb5)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:27.234200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: WARNING py.warnings [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:34:27.234200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: warnings.warn(msg) Aug 23 16:34:27.234200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: Aug 23 16:34:27.237595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:28.442344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14897169009484aa4b469130ebc7cb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.443416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14897169009484aa4b469130ebc7cb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.444044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14897169009484aa4b469130ebc7cb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.464338 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:28.466791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:28.490732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49047d1-8ef3-4e86-be15-c120b0db55f8 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:28.505267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:28.506133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:28.506727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:28.507142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] PATH_INFO: `/v3/projects/4caab1ba61954fa58c5813f19117fb6a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:28.510582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4caab1ba61954fa58c5813f19117fb6a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:28.511846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: WARNING py.warnings [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:34:28.511846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: warnings.warn(msg) Aug 23 16:34:28.511846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: Aug 23 16:34:28.516959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:28.524433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14897169009484aa4b469130ebc7cb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.646049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cfe57912-e54f-4162-98aa-5a4216da79c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14897169009484aa4b469130ebc7cb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.687410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 828/1640] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:27 2022] DELETE /identity/v3/users/e14897169009484aa4b469130ebc7cb5 => generated 0 bytes in 1514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:28.699544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee3f1c-ecbf-4630-bf6f-8d638cd7c5cd None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:28.700167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee3f1c-ecbf-4630-bf6f-8d638cd7c5cd None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:28.700638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee3f1c-ecbf-4630-bf6f-8d638cd7c5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:28.762608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-54ee3f1c-ecbf-4630-bf6f-8d638cd7c5cd None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:28.768287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-54ee3f1c-ecbf-4630-bf6f-8d638cd7c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:28.776616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4caab1ba61954fa58c5813f19117fb6a', 'request_id': 'req-e2d0721b-55e9-43f2-a817-70f5b5063326'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.912514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4caab1ba61954fa58c5813f19117fb6a', 'request_id': 'req-e2d0721b-55e9-43f2-a817-70f5b5063326'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.919890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 829/1641] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:28.934654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4caab1ba61954fa58c5813f19117fb6a', 'request_id': 'req-e2d0721b-55e9-43f2-a817-70f5b5063326'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.954833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] The token cache is being invalidate because project 4caab1ba61954fa58c5813f19117fb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:28.955196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.960078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:28.962019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 813/1642] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:28 2022] DELETE /identity/v3/projects/4caab1ba61954fa58c5813f19117fb6a => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:34:28.967912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee3f1c-ecbf-4630-bf6f-8d638cd7c5cd None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:28.970000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-54ee3f1c-ecbf-4630-bf6f-8d638cd7c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:28.999637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee3f1c-ecbf-4630-bf6f-8d638cd7c5cd None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:29.016454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:29.017978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:29.018260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:29.020867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] PATH_INFO: `/v3/users/b527417933364862b4b9a2489fede78e` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:29.024185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b527417933364862b4b9a2489fede78e)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:29.030921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:29.035994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:29.037692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:29.071257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:29.134450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0721b-55e9-43f2-a817-70f5b5063326 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:29.138778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:29.139553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:29.140164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:29.140553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:29.142509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:29.156571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:29.158371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:29.172512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 814/1643] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:34:29.299772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b527417933364862b4b9a2489fede78e'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.305062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b527417933364862b4b9a2489fede78e'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.306752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b527417933364862b4b9a2489fede78e'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.441878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b527417933364862b4b9a2489fede78e'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.485001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-766cdbc5-d9fb-4ee7-9a39-78fa83b9b007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b527417933364862b4b9a2489fede78e'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.508308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 830/1644] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:28 2022] DELETE /identity/v3/users/b527417933364862b4b9a2489fede78e => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:31.060010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:31.060010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:31.078898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f85f79-5f15-46d1-a308-ce3d11e3710d service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:31.292678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:31.294206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:31.294206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:31.294206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] PATH_INFO: `/v3/users/64b85c9b98734971bfe8ad73f472a0bd` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:31.300165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b85c9b98734971bfe8ad73f472a0bd)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:31.308459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:31.322896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:31.403606 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f475-8ab6-4aa8-8d79-2b1b4b22008e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:31.404180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f475-8ab6-4aa8-8d79-2b1b4b22008e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:31.404180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97f475-8ab6-4aa8-8d79-2b1b4b22008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:31.472046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1f97f475-8ab6-4aa8-8d79-2b1b4b22008e None None] MFA Rules not processed for user `f2d6e1a8b75547468e2294bff8274c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:31.474787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1f97f475-8ab6-4aa8-8d79-2b1b4b22008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:31.622224 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b85c9b98734971bfe8ad73f472a0bd'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:31.659200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b85c9b98734971bfe8ad73f472a0bd'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:31.660668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b85c9b98734971bfe8ad73f472a0bd'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:31.661571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b85c9b98734971bfe8ad73f472a0bd'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:31.670369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 831/1645] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 23 16:34:31.671896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97f475-8ab6-4aa8-8d79-2b1b4b22008e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:31.677188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1f97f475-8ab6-4aa8-8d79-2b1b4b22008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:31.695567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b85c9b98734971bfe8ad73f472a0bd'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:31.709913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97f475-8ab6-4aa8-8d79-2b1b4b22008e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:31.716295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:31.716960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:31.722824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:31.722824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] PATH_INFO: `/v3/projects/2c15c6981fdc49d587b83331ad591385` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:31.722824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c15c6981fdc49d587b83331ad591385)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:31.722824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:31.784816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 815/1646] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:31 2022] DELETE /identity/v3/users/64b85c9b98734971bfe8ad73f472a0bd => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:31.786321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:31.788596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:31.920222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c15c6981fdc49d587b83331ad591385', 'request_id': 'req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:31.934367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c15c6981fdc49d587b83331ad591385', 'request_id': 'req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:31.978030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066fc8-7ccf-4ea7-bba3-727ad9b1ed43 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:32.006968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c15c6981fdc49d587b83331ad591385', 'request_id': 'req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:32.024694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] The token cache is being invalidate because project 2c15c6981fdc49d587b83331ad591385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:32.026125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:32.028306 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:32.033656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 832/1647] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:31 2022] DELETE /identity/v3/projects/2c15c6981fdc49d587b83331ad591385 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:32.036626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:32.040981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:32.072540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:32.175076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c78bd-627d-49cf-aa39-16e4c4e7ef76 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:32.188241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b417d-204b-43d5-a136-2c84d3f1f04c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:32.188884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b417d-204b-43d5-a136-2c84d3f1f04c service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.189942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b417d-204b-43d5-a136-2c84d3f1f04c service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.190540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b417d-204b-43d5-a136-2c84d3f1f04c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.191199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:32.192029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.192413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.192789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] PATH_INFO: `/v3/projects/2650b0a0245b4e4790d03f2cdb2d9d14` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.194168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2650b0a0245b4e4790d03f2cdb2d9d14)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:32.196667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:32.198232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3c7b417d-204b-43d5-a136-2c84d3f1f04c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:32.344725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b417d-204b-43d5-a136-2c84d3f1f04c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:32.349204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b417d-204b-43d5-a136-2c84d3f1f04c service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:32.367084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2650b0a0245b4e4790d03f2cdb2d9d14', 'request_id': 'req-33704a37-fcd7-4823-8df7-e42194e05d09'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:32.381524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2650b0a0245b4e4790d03f2cdb2d9d14', 'request_id': 'req-33704a37-fcd7-4823-8df7-e42194e05d09'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:32.394149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 816/1648] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:32.395909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc24dd-61f5-404c-86a9-5346743c5cc4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.396402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc24dd-61f5-404c-86a9-5346743c5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.396871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc24dd-61f5-404c-86a9-5346743c5cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.446996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0ccc24dd-61f5-404c-86a9-5346743c5cc4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:32.446996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0ccc24dd-61f5-404c-86a9-5346743c5cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:32.470291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2650b0a0245b4e4790d03f2cdb2d9d14', 'request_id': 'req-33704a37-fcd7-4823-8df7-e42194e05d09'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:32.513917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] The token cache is being invalidate because project 2650b0a0245b4e4790d03f2cdb2d9d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:32.514263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:32.516858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-33704a37-fcd7-4823-8df7-e42194e05d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:32.524917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 833/1649] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:32 2022] DELETE /identity/v3/projects/2650b0a0245b4e4790d03f2cdb2d9d14 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:32.524917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9774-eee7-4248-a514-f673f0b2cfe9 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.525340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9774-eee7-4248-a514-f673f0b2cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.525785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9774-eee7-4248-a514-f673f0b2cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.591467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f0ba9774-eee7-4248-a514-f673f0b2cfe9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:32.596819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f0ba9774-eee7-4248-a514-f673f0b2cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:32.608541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 817/1650] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:32.616002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 834/1651] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:32.616123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb355-69a9-4509-86fb-03192b94a029 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.616123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb355-69a9-4509-86fb-03192b94a029 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.616123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb355-69a9-4509-86fb-03192b94a029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.625331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a5a9-b9b5-4f7b-b324-ba449be3b859 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.625769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a5a9-b9b5-4f7b-b324-ba449be3b859 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.625919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06a5a9-b9b5-4f7b-b324-ba449be3b859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.660057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-512cb355-69a9-4509-86fb-03192b94a029 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:32.662287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-512cb355-69a9-4509-86fb-03192b94a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:32.670429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7a06a5a9-b9b5-4f7b-b324-ba449be3b859 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:32.671670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7a06a5a9-b9b5-4f7b-b324-ba449be3b859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:32.677366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 818/1652] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:32.678287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cb355-69a9-4509-86fb-03192b94a029 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:32.679828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-512cb355-69a9-4509-86fb-03192b94a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:32.702122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 835/1653] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:32.703324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81366-bcba-4adf-8198-f743f1a29c97 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.703619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81366-bcba-4adf-8198-f743f1a29c97 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.703898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81366-bcba-4adf-8198-f743f1a29c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.740532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-46e81366-bcba-4adf-8198-f743f1a29c97 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:32.742309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-46e81366-bcba-4adf-8198-f743f1a29c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:32.758071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 836/1654] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:32.758925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81366-bcba-4adf-8198-f743f1a29c97 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:32.770257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81366-bcba-4adf-8198-f743f1a29c97 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:32.782481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:32.783120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.783987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.784264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.784943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:32.785252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:32.786921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:32.790857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cb355-69a9-4509-86fb-03192b94a029 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:32.799935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324674-7b23-4972-81f0-8852b08adf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:32.800718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324674-7b23-4972-81f0-8852b08adf3b service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.800850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324674-7b23-4972-81f0-8852b08adf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.801115 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324674-7b23-4972-81f0-8852b08adf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.816069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 837/1655] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:32.816069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:32.816717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324674-7b23-4972-81f0-8852b08adf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:32.818230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324674-7b23-4972-81f0-8852b08adf3b service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:32.851041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49742fd3-4770-46ec-befd-111251dc0e9f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:32.864750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 819/1656] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:32.865839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324674-7b23-4972-81f0-8852b08adf3b service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:32.875188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:32.876768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.876768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.876768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.877082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:32.877373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:32.879134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:32.891875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324674-7b23-4972-81f0-8852b08adf3b service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:32.906590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a165c90-a4a4-409e-b86a-33f884003519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:32.907215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a165c90-a4a4-409e-b86a-33f884003519 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.907498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a165c90-a4a4-409e-b86a-33f884003519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.907773 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a165c90-a4a4-409e-b86a-33f884003519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.908471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a165c90-a4a4-409e-b86a-33f884003519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:32.910434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a165c90-a4a4-409e-b86a-33f884003519 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:32.916361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 838/1657] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:32.926860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:32.939327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76168bfc-091b-4628-971a-f8991d7aa038 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:32.949927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26732e7-7084-4ec3-9372-54430d10647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:32.950655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26732e7-7084-4ec3-9372-54430d10647e admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:32.950998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26732e7-7084-4ec3-9372-54430d10647e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:32.953361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26732e7-7084-4ec3-9372-54430d10647e admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:32.953361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26732e7-7084-4ec3-9372-54430d10647e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:32.954284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26732e7-7084-4ec3-9372-54430d10647e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.044990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:33.076680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 820/1658] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:32 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:33.077846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 839/1659] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:32 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:33.078489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a165c90-a4a4-409e-b86a-33f884003519 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:33.080974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26732e7-7084-4ec3-9372-54430d10647e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:33.254569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a165c90-a4a4-409e-b86a-33f884003519 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:33.261987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26732e7-7084-4ec3-9372-54430d10647e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:33.273730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609731-1bab-4a75-94c1-366ca0db7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:33.275865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609731-1bab-4a75-94c1-366ca0db7bda admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.276162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609731-1bab-4a75-94c1-366ca0db7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.276445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609731-1bab-4a75-94c1-366ca0db7bda admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.276973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa69b2-180a-40bd-932b-36a9db511fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:33.278439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609731-1bab-4a75-94c1-366ca0db7bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:33.280492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609731-1bab-4a75-94c1-366ca0db7bda admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.280678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa69b2-180a-40bd-932b-36a9db511fff admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.280981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa69b2-180a-40bd-932b-36a9db511fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.281274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa69b2-180a-40bd-932b-36a9db511fff admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.284917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa69b2-180a-40bd-932b-36a9db511fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:33.290390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa69b2-180a-40bd-932b-36a9db511fff admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.370105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 840/1660] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:33 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:33.374004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609731-1bab-4a75-94c1-366ca0db7bda admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:33.403566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609731-1bab-4a75-94c1-366ca0db7bda admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:33.418825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f731897-5171-4289-9ec2-8b21f9837fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:33.419866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f731897-5171-4289-9ec2-8b21f9837fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.421591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f731897-5171-4289-9ec2-8b21f9837fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.422110 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f731897-5171-4289-9ec2-8b21f9837fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.423250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f731897-5171-4289-9ec2-8b21f9837fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:33.427174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f731897-5171-4289-9ec2-8b21f9837fc4 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.457191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 821/1661] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:33 2022] POST /identity/v3/users => generated 287 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:34:33.459261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 841/1662] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:33.463898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa69b2-180a-40bd-932b-36a9db511fff admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:33.465061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f731897-5171-4289-9ec2-8b21f9837fc4 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:33.489519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f731897-5171-4289-9ec2-8b21f9837fc4 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:33.490793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa69b2-180a-40bd-932b-36a9db511fff admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:33.503884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc698e8-ca28-47cb-b34e-d6ba71b63247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:33.504244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4578f-7fed-4759-bcf0-ec564e0f236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:33.505039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4578f-7fed-4759-bcf0-ec564e0f236d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.505347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4578f-7fed-4759-bcf0-ec564e0f236d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.505727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4578f-7fed-4759-bcf0-ec564e0f236d admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.507186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4578f-7fed-4759-bcf0-ec564e0f236d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:33.507663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc698e8-ca28-47cb-b34e-d6ba71b63247 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.508147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc698e8-ca28-47cb-b34e-d6ba71b63247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.508790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc698e8-ca28-47cb-b34e-d6ba71b63247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.510395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4578f-7fed-4759-bcf0-ec564e0f236d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.513032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc698e8-ca28-47cb-b34e-d6ba71b63247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:33.515999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc698e8-ca28-47cb-b34e-d6ba71b63247 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.534773 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 822/1663] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:33.538776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4578f-7fed-4759-bcf0-ec564e0f236d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:33.544215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 842/1664] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:33.549148 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc698e8-ca28-47cb-b34e-d6ba71b63247 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:33.570835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4578f-7fed-4759-bcf0-ec564e0f236d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:33.572933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc698e8-ca28-47cb-b34e-d6ba71b63247 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:33.584438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dde4bb-ba29-4e89-bba3-ed2b23c54834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:33.585531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde4bb-ba29-4e89-bba3-ed2b23c54834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.588272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde4bb-ba29-4e89-bba3-ed2b23c54834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.588809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dde4bb-ba29-4e89-bba3-ed2b23c54834 admin admin] PATH_INFO: `/v3/projects/ad9f660cd2aa4aeab90b7ba324299463/users/21647f2da45b460ca1655602a4c5f98b/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.590592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056ef5-9609-4c7c-b1c9-b1e240c04c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:33.591337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056ef5-9609-4c7c-b1c9-b1e240c04c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.591635 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056ef5-9609-4c7c-b1c9-b1e240c04c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.591915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9056ef5-9609-4c7c-b1c9-b1e240c04c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.592581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9056ef5-9609-4c7c-b1c9-b1e240c04c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:33.594271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9056ef5-9609-4c7c-b1c9-b1e240c04c61 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.632898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde4bb-ba29-4e89-bba3-ed2b23c54834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9f660cd2aa4aeab90b7ba324299463, user_id=21647f2da45b460ca1655602a4c5f98b, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:33.635483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 823/1665] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:33.636711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056ef5-9609-4c7c-b1c9-b1e240c04c61 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:33.639794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dde4bb-ba29-4e89-bba3-ed2b23c54834 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.664147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9056ef5-9609-4c7c-b1c9-b1e240c04c61 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:33.678196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87550a-93b2-4ad9-ab35-aedee2fe25cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:33.679052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87550a-93b2-4ad9-ab35-aedee2fe25cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.679390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87550a-93b2-4ad9-ab35-aedee2fe25cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.680152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87550a-93b2-4ad9-ab35-aedee2fe25cf admin admin] PATH_INFO: `/v3/projects/f68919e22b2c4893a4ceb1e047f8442f/users/5d96c1b010cc4fe884432b3f4d826eb5/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.717845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87550a-93b2-4ad9-ab35-aedee2fe25cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68919e22b2c4893a4ceb1e047f8442f, user_id=5d96c1b010cc4fe884432b3f4d826eb5, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:33.724590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87550a-93b2-4ad9-ab35-aedee2fe25cf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:33.760778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:33.769909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 843/1666] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:33 2022] PUT /identity/v3/projects/ad9f660cd2aa4aeab90b7ba324299463/users/21647f2da45b460ca1655602a4c5f98b/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:33.781348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bebc68-bad0-42dc-887a-7d026c8328c4 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.781672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bebc68-bad0-42dc-887a-7d026c8328c4 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.782007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bebc68-bad0-42dc-887a-7d026c8328c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.850471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-73bebc68-bad0-42dc-887a-7d026c8328c4 None None] MFA Rules not processed for user `21647f2da45b460ca1655602a4c5f98b`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:33.852671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 824/1667] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:33 2022] PUT /identity/v3/projects/f68919e22b2c4893a4ceb1e047f8442f/users/5d96c1b010cc4fe884432b3f4d826eb5/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:33.853266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-73bebc68-bad0-42dc-887a-7d026c8328c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:33.863509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3de7e-3e97-427b-bce6-289b82c8a4b1 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:33.863796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3de7e-3e97-427b-bce6-289b82c8a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:33.864074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3de7e-3e97-427b-bce6-289b82c8a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:33.927470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2cc3de7e-3e97-427b-bce6-289b82c8a4b1 None None] MFA Rules not processed for user `5d96c1b010cc4fe884432b3f4d826eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:33.928655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2cc3de7e-3e97-427b-bce6-289b82c8a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:34.030373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 844/1668] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:34:34.034670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bebc68-bad0-42dc-887a-7d026c8328c4 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:34.079620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 825/1669] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:34.084255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3de7e-3e97-427b-bce6-289b82c8a4b1 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:34.182168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bebc68-bad0-42dc-887a-7d026c8328c4 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:34.203695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13feb2-30cc-4460-808a-c332aa900c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:34.204652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13feb2-30cc-4460-808a-c332aa900c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:34.205205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13feb2-30cc-4460-808a-c332aa900c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:34.206225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13feb2-30cc-4460-808a-c332aa900c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:34.207104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13feb2-30cc-4460-808a-c332aa900c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:34.212104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13feb2-30cc-4460-808a-c332aa900c02 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:34.223961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3de7e-3e97-427b-bce6-289b82c8a4b1 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:34.248956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519008-cd4a-49b5-9583-37bb56bf43cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:34.249909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519008-cd4a-49b5-9583-37bb56bf43cc admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:34.250346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519008-cd4a-49b5-9583-37bb56bf43cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:34.250790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519008-cd4a-49b5-9583-37bb56bf43cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:34.252513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81519008-cd4a-49b5-9583-37bb56bf43cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:34.255308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81519008-cd4a-49b5-9583-37bb56bf43cc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:34.403411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 826/1670] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:34 2022] POST /identity/v3/projects => generated 373 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:34:34.410420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519008-cd4a-49b5-9583-37bb56bf43cc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:34.442123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 845/1671] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:34 2022] POST /identity/v3/projects => generated 363 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:34.443140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13feb2-30cc-4460-808a-c332aa900c02 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:34.662289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519008-cd4a-49b5-9583-37bb56bf43cc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:34.683568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6ca66-9fd3-4aeb-84d8-cea383835e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:34.684141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6ca66-9fd3-4aeb-84d8-cea383835e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:34.684434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6ca66-9fd3-4aeb-84d8-cea383835e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:34.684712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6ca66-9fd3-4aeb-84d8-cea383835e10 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:34.685368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6ca66-9fd3-4aeb-84d8-cea383835e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:34.687424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6ca66-9fd3-4aeb-84d8-cea383835e10 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:34.689111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13feb2-30cc-4460-808a-c332aa900c02 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:34.711701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e174ec-c7ad-4388-9f85-4d9e4780ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:34.712410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e174ec-c7ad-4388-9f85-4d9e4780ee53 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:34.712702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e174ec-c7ad-4388-9f85-4d9e4780ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:34.712977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e174ec-c7ad-4388-9f85-4d9e4780ee53 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:34.713636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e174ec-c7ad-4388-9f85-4d9e4780ee53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:34.728043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e174ec-c7ad-4388-9f85-4d9e4780ee53 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:34.828311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 827/1672] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:34 2022] POST /identity/v3/users => generated 293 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:34.838413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6ca66-9fd3-4aeb-84d8-cea383835e10 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:34.850116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:34.857348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6ca66-9fd3-4aeb-84d8-cea383835e10 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:34.859549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 846/1673] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:34 2022] POST /identity/v3/users => generated 288 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:34.864093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e174ec-c7ad-4388-9f85-4d9e4780ee53 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:34.867503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b85f-b3d7-4064-890c-8ca964dc670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:34.868429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b85f-b3d7-4064-890c-8ca964dc670d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:34.868921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b85f-b3d7-4064-890c-8ca964dc670d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:34.869400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b85f-b3d7-4064-890c-8ca964dc670d admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:34.870795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440b85f-b3d7-4064-890c-8ca964dc670d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:34.872886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440b85f-b3d7-4064-890c-8ca964dc670d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:34.885729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 828/1674] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:34.891225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b85f-b3d7-4064-890c-8ca964dc670d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:34.916673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b85f-b3d7-4064-890c-8ca964dc670d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:34.916825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e174ec-c7ad-4388-9f85-4d9e4780ee53 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:34.916931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc79aa-cc89-46e3-bf06-0ebda320fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:34.917390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc79aa-cc89-46e3-bf06-0ebda320fcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:34.917812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc79aa-cc89-46e3-bf06-0ebda320fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:34.918324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc79aa-cc89-46e3-bf06-0ebda320fcfe admin admin] PATH_INFO: `/v3/projects/d8a8638ed14445d69a16a09375ab6139/users/4fc77dbf2d604c37b524c5e5327e626f/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:34.929715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:34.930035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:34.930300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:34.932548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:34.933254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:34.934996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:34.951260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc79aa-cc89-46e3-bf06-0ebda320fcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a8638ed14445d69a16a09375ab6139, user_id=4fc77dbf2d604c37b524c5e5327e626f, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:34.954265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc79aa-cc89-46e3-bf06-0ebda320fcfe admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:34.981785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 847/1675] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:34.983650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:34.988831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:35.044208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d67652-57e2-41f6-87f7-5742e9e3c17e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:35.065363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 829/1676] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:34 2022] PUT /identity/v3/projects/d8a8638ed14445d69a16a09375ab6139/users/4fc77dbf2d604c37b524c5e5327e626f/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:35.066564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc79aa-cc89-46e3-bf06-0ebda320fcfe admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:35.070397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:35.071058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:35.071509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:35.072613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] PATH_INFO: `/v3/projects/21914d0039c64691bc3f0df327ac6643` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:35.076248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=21914d0039c64691bc3f0df327ac6643)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:35.087632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:35.291735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc79aa-cc89-46e3-bf06-0ebda320fcfe admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:35.324171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21914d0039c64691bc3f0df327ac6643', 'request_id': 'req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:35.337224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21914d0039c64691bc3f0df327ac6643', 'request_id': 'req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:35.431650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21914d0039c64691bc3f0df327ac6643', 'request_id': 'req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:35.449597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad94b6-95eb-4ff7-8c16-2d03d4828bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:35.450311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad94b6-95eb-4ff7-8c16-2d03d4828bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:35.450602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad94b6-95eb-4ff7-8c16-2d03d4828bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:35.450882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad94b6-95eb-4ff7-8c16-2d03d4828bc5 admin admin] PATH_INFO: `/v3/projects/020b46fac9da4b59ac3ec40862485582/users/1184c80bb7e64e60835b125f68691d81/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:35.463277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] The token cache is being invalidate because project 21914d0039c64691bc3f0df327ac6643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:35.463277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:35.464552 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:35.473401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 848/1677] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:34 2022] DELETE /identity/v3/projects/21914d0039c64691bc3f0df327ac6643 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:35.473401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:35.477121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:35.477248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad94b6-95eb-4ff7-8c16-2d03d4828bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020b46fac9da4b59ac3ec40862485582, user_id=1184c80bb7e64e60835b125f68691d81, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:35.479902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad94b6-95eb-4ff7-8c16-2d03d4828bc5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:35.517431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d4e5-26be-45b9-b4c0-ae829bafa1ba admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:35.535188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e53ddb-8306-4329-922d-87fedcd640d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:35.535837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53ddb-8306-4329-922d-87fedcd640d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:35.536122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53ddb-8306-4329-922d-87fedcd640d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:35.536399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e53ddb-8306-4329-922d-87fedcd640d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:35.537266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e53ddb-8306-4329-922d-87fedcd640d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:35.540646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e53ddb-8306-4329-922d-87fedcd640d1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:35.570035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 849/1678] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:35.572246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaff1a-e4c3-4f8f-99fc-83150fbe1633 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:35.573913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaff1a-e4c3-4f8f-99fc-83150fbe1633 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:35.574435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaff1a-e4c3-4f8f-99fc-83150fbe1633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:35.623525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 830/1679] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:35 2022] PUT /identity/v3/projects/020b46fac9da4b59ac3ec40862485582/users/1184c80bb7e64e60835b125f68691d81/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:35.625028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba744a9-f09a-4332-a784-916969e46d61 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:35.625767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba744a9-f09a-4332-a784-916969e46d61 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:35.626055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba744a9-f09a-4332-a784-916969e46d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:35.628209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-edeaff1a-e4c3-4f8f-99fc-83150fbe1633 None None] MFA Rules not processed for user `98c81b8a6a7b4c5ab328d9095ef5b1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:35.630128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-edeaff1a-e4c3-4f8f-99fc-83150fbe1633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:35.716861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-eba744a9-f09a-4332-a784-916969e46d61 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:35.722420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-eba744a9-f09a-4332-a784-916969e46d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:35.730181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 850/1680] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:35.731892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaff1a-e4c3-4f8f-99fc-83150fbe1633 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:35.900309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 831/1681] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:35.907031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba744a9-f09a-4332-a784-916969e46d61 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:35.907343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-eba744a9-f09a-4332-a784-916969e46d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:35.915183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaff1a-e4c3-4f8f-99fc-83150fbe1633 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:35.937597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba744a9-f09a-4332-a784-916969e46d61 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:35.940216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8580a-aaf5-4c6c-a7f4-3e2e1d71b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:35.941853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8580a-aaf5-4c6c-a7f4-3e2e1d71b749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:35.942261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8580a-aaf5-4c6c-a7f4-3e2e1d71b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:35.942676 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8580a-aaf5-4c6c-a7f4-3e2e1d71b749 admin admin] PATH_INFO: `/v3/projects/d8a8638ed14445d69a16a09375ab6139/users/4fc77dbf2d604c37b524c5e5327e626f/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:35.946904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8580a-aaf5-4c6c-a7f4-3e2e1d71b749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a8638ed14445d69a16a09375ab6139, user_id=4fc77dbf2d604c37b524c5e5327e626f, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:35.950088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8580a-aaf5-4c6c-a7f4-3e2e1d71b749 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:35.954062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:35.954852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:35.956054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:35.956483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:35.957310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:35.959244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:35.977638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 832/1682] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:35.979169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:35.981416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:35.992326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 851/1683] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:35 2022] PUT /identity/v3/projects/d8a8638ed14445d69a16a09375ab6139/users/4fc77dbf2d604c37b524c5e5327e626f/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:35.997832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f62f82-19c3-4bd0-917c-806828ce791c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:35.998127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f62f82-19c3-4bd0-917c-806828ce791c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:35.998414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f62f82-19c3-4bd0-917c-806828ce791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:35.998614 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67ffd6-fcd5-4ee5-8a3c-0381a3400f33 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:36.070908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-87f62f82-19c3-4bd0-917c-806828ce791c None None] MFA Rules not processed for user `98c81b8a6a7b4c5ab328d9095ef5b1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:36.072167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-87f62f82-19c3-4bd0-917c-806828ce791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:36.090290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:36.091964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:36.092252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:36.092529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] PATH_INFO: `/v3/users/6f52478f18824ed2bd2cd78eb41b88ca` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:36.095112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f52478f18824ed2bd2cd78eb41b88ca)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:36.099299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:36.149990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:36.191758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 852/1684] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:36.203410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deabc9-e3b6-459b-b4c3-019dc42914f8 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:36.203410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deabc9-e3b6-459b-b4c3-019dc42914f8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:36.203410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deabc9-e3b6-459b-b4c3-019dc42914f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:36.240555 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-a5deabc9-e3b6-459b-b4c3-019dc42914f8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:36.242868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a5deabc9-e3b6-459b-b4c3-019dc42914f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:36.261294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 853/1685] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:36.265827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5deabc9-e3b6-459b-b4c3-019dc42914f8 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:36.277694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5deabc9-e3b6-459b-b4c3-019dc42914f8 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:36.283129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bc4fc-c687-4c7d-a086-5d30d67bd26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:36.284526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bc4fc-c687-4c7d-a086-5d30d67bd26f admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:36.285023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bc4fc-c687-4c7d-a086-5d30d67bd26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:36.285914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bc4fc-c687-4c7d-a086-5d30d67bd26f admin admin] PATH_INFO: `/v3/projects/020b46fac9da4b59ac3ec40862485582/users/1184c80bb7e64e60835b125f68691d81/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:36.288416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bc4fc-c687-4c7d-a086-5d30d67bd26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=020b46fac9da4b59ac3ec40862485582, user_id=1184c80bb7e64e60835b125f68691d81, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:36.295737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bc4fc-c687-4c7d-a086-5d30d67bd26f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:36.321645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 854/1686] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:36 2022] PUT /identity/v3/projects/020b46fac9da4b59ac3ec40862485582/users/1184c80bb7e64e60835b125f68691d81/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:36.333590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177a38-81f3-4a15-a423-3b763e1ff573 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:36.334003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177a38-81f3-4a15-a423-3b763e1ff573 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:36.334989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64177a38-81f3-4a15-a423-3b763e1ff573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:36.364656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f52478f18824ed2bd2cd78eb41b88ca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:36.374765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f52478f18824ed2bd2cd78eb41b88ca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:36.375977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f52478f18824ed2bd2cd78eb41b88ca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:36.377022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f52478f18824ed2bd2cd78eb41b88ca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:36.407439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f52478f18824ed2bd2cd78eb41b88ca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:36.445540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-64177a38-81f3-4a15-a423-3b763e1ff573 None None] MFA Rules not processed for user `4fc77dbf2d604c37b524c5e5327e626f`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:36.447296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-64177a38-81f3-4a15-a423-3b763e1ff573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:36.531122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 833/1687] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:35 2022] DELETE /identity/v3/users/6f52478f18824ed2bd2cd78eb41b88ca => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:36.547168 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:36.554002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:36.619338 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:36.671182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 855/1688] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:36.671182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64177a38-81f3-4a15-a423-3b763e1ff573 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:36.677159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-64177a38-81f3-4a15-a423-3b763e1ff573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:36.833795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64177a38-81f3-4a15-a423-3b763e1ff573 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:36.864075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2897b0-223e-4196-9e8d-e14fca06c39f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:36.882524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee305d2-1331-466d-88e3-88875029a474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:36.883719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee305d2-1331-466d-88e3-88875029a474 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:36.885009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee305d2-1331-466d-88e3-88875029a474 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:36.887160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee305d2-1331-466d-88e3-88875029a474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:36.893865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bee305d2-1331-466d-88e3-88875029a474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:36.947000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3c472-f58b-4400-981c-0e8c34bf6165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:36.947638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3c472-f58b-4400-981c-0e8c34bf6165 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:36.947917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3c472-f58b-4400-981c-0e8c34bf6165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:36.948190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3c472-f58b-4400-981c-0e8c34bf6165 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:36.952755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3c472-f58b-4400-981c-0e8c34bf6165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:36.953093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3c472-f58b-4400-981c-0e8c34bf6165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:36.956145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3c472-f58b-4400-981c-0e8c34bf6165 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:36.990785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 856/1689] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:36.994607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757da792-30cc-4fae-9033-392c63e07a09 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:36.995915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757da792-30cc-4fae-9033-392c63e07a09 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:36.996354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757da792-30cc-4fae-9033-392c63e07a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:37.054130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee305d2-1331-466d-88e3-88875029a474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:37.058818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee305d2-1331-466d-88e3-88875029a474 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:37.066924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-757da792-30cc-4fae-9033-392c63e07a09 None None] MFA Rules not processed for user `1184c80bb7e64e60835b125f68691d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:37.068431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-757da792-30cc-4fae-9033-392c63e07a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:37.086461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 834/1690] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:37.089544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c732f-fe09-4189-84c6-8ecbae5aabba None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:37.090894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c732f-fe09-4189-84c6-8ecbae5aabba None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:37.092681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c732f-fe09-4189-84c6-8ecbae5aabba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:37.139388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7e0c732f-fe09-4189-84c6-8ecbae5aabba None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:37.143655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7e0c732f-fe09-4189-84c6-8ecbae5aabba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:37.166416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 835/1691] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:37.178055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c732f-fe09-4189-84c6-8ecbae5aabba None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:37.178055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7e0c732f-fe09-4189-84c6-8ecbae5aabba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:37.237944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 857/1692] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:37.238881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757da792-30cc-4fae-9033-392c63e07a09 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:37.264409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757da792-30cc-4fae-9033-392c63e07a09 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:37.279764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:37.280399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:37.280681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:37.280954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:37.281774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:37.283767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:37.324391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c732f-fe09-4189-84c6-8ecbae5aabba None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:37.336754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada528-a2b1-4651-b9e9-43231157f333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:37.339254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada528-a2b1-4651-b9e9-43231157f333 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:37.339254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada528-a2b1-4651-b9e9-43231157f333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:37.339254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada528-a2b1-4651-b9e9-43231157f333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:37.384107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 858/1693] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:37 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:37.384502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:37.389458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:37.401318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:37.502118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada528-a2b1-4651-b9e9-43231157f333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:37.506353 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada528-a2b1-4651-b9e9-43231157f333 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:37.522107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 836/1694] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:37.524063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912ec4-9ff0-429f-9823-a99cb576cd8a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:37.524590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912ec4-9ff0-429f-9823-a99cb576cd8a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:37.525148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912ec4-9ff0-429f-9823-a99cb576cd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:37.546731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b543d1-4bf5-4172-adb6-71d8ca7ffcc7 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:37.564167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-90912ec4-9ff0-429f-9823-a99cb576cd8a None None] MFA Rules not processed for user `7406a426e16a415e9c1f457f58a0871b`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:37.567839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:37.568561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:37.568982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:37.569267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:37.576662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-90912ec4-9ff0-429f-9823-a99cb576cd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:37.584078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:37.654819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:37.656548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:37.683797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 859/1695] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:37.685346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 837/1696] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:37.686315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912ec4-9ff0-429f-9823-a99cb576cd8a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:37.691546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:37.693950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:37.706743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912ec4-9ff0-429f-9823-a99cb576cd8a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:37.718268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:37.721387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:37.721387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:37.721387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:37.721387 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:37.725004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:37.779045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9b170-50bc-4be4-8320-196086761ded service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:37.782857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c6b0-a77c-4d15-8727-61814f307dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:37.784016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c6b0-a77c-4d15-8727-61814f307dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:37.784963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c6b0-a77c-4d15-8727-61814f307dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:37.785432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87c6b0-a77c-4d15-8727-61814f307dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:37.859876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 838/1697] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:37 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:37.860857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:37.864723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:37.948811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87c6b0-a77c-4d15-8727-61814f307dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:37.951013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87c6b0-a77c-4d15-8727-61814f307dc0 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:37.962288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 860/1698] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:37.963090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c6b0-a77c-4d15-8727-61814f307dc0 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:38.003590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b652-1149-415d-bfcf-8e36f486d149 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:38.013140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87c6b0-a77c-4d15-8727-61814f307dc0 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:38.018699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315f616-4911-45b5-8c00-d7ab0b0c97dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:38.019723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f616-4911-45b5-8c00-d7ab0b0c97dd service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.029855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148c0e6-5f0c-4687-b113-dafa3e99bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:38.035016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f616-4911-45b5-8c00-d7ab0b0c97dd service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.035620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f616-4911-45b5-8c00-d7ab0b0c97dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.036344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c0e6-5f0c-4687-b113-dafa3e99bc34 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.038087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c0e6-5f0c-4687-b113-dafa3e99bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.038372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148c0e6-5f0c-4687-b113-dafa3e99bc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.039239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148c0e6-5f0c-4687-b113-dafa3e99bc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:38.044972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148c0e6-5f0c-4687-b113-dafa3e99bc34 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:38.047247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315f616-4911-45b5-8c00-d7ab0b0c97dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:38.049050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315f616-4911-45b5-8c00-d7ab0b0c97dd service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:38.073258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 861/1699] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:38.074313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148c0e6-5f0c-4687-b113-dafa3e99bc34 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:38.089401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148c0e6-5f0c-4687-b113-dafa3e99bc34 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:38.096858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:38.097494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.097916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 839/1700] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:38.099925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.100257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.101686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a405449-755b-4121-b5a3-4ed91cae5e9b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.103683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a405449-755b-4121-b5a3-4ed91cae5e9b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.106378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a405449-755b-4121-b5a3-4ed91cae5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.108870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:38.217690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4a405449-755b-4121-b5a3-4ed91cae5e9b None None] MFA Rules not processed for user `ab934520bd5e4a5e9c82fdfacbf99f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:38.219085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4a405449-755b-4121-b5a3-4ed91cae5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:38.289644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:38.291123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:38.304071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 862/1701] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:38.304942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:38.391705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01da01-4d65-4482-a588-1bae4b292a00 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:38.400399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4ca5-5cec-4969-b3f0-d489edd3151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:38.401443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4ca5-5cec-4969-b3f0-d489edd3151f admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.401443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4ca5-5cec-4969-b3f0-d489edd3151f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.401786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4ca5-5cec-4969-b3f0-d489edd3151f admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.402277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4ca5-5cec-4969-b3f0-d489edd3151f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:38.403914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4ca5-5cec-4969-b3f0-d489edd3151f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:38.427436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 863/1702] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:38.429294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee81d3-890d-4c05-a3c0-e2db1788e9e1 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.429581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee81d3-890d-4c05-a3c0-e2db1788e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.429884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee81d3-890d-4c05-a3c0-e2db1788e9e1 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.431247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 864/1703] 10.222.0.61 () {54 vars in 912 bytes} [Tue Aug 23 16:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:34:38.438531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816372-ebaa-46b3-a47e-e107ff0eba69 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.438918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816372-ebaa-46b3-a47e-e107ff0eba69 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.439159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5816372-ebaa-46b3-a47e-e107ff0eba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.442309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 840/1704] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:38.446447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a405449-755b-4121-b5a3-4ed91cae5e9b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:38.478480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f5816372-ebaa-46b3-a47e-e107ff0eba69 None None] MFA Rules not processed for user `f2d6e1a8b75547468e2294bff8274c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:38.478825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a405449-755b-4121-b5a3-4ed91cae5e9b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:38.479897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f5816372-ebaa-46b3-a47e-e107ff0eba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:38.490747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41c42-2cb6-4a08-8d3c-3bfe1633cc51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:38.490747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41c42-2cb6-4a08-8d3c-3bfe1633cc51 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.490747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41c42-2cb6-4a08-8d3c-3bfe1633cc51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.490747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41c42-2cb6-4a08-8d3c-3bfe1633cc51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.498664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2be41c42-2cb6-4a08-8d3c-3bfe1633cc51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:38.603351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 865/1705] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:38.607793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816372-ebaa-46b3-a47e-e107ff0eba69 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:38.627748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5816372-ebaa-46b3-a47e-e107ff0eba69 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:38.634740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98be7a2-0c24-431d-96ae-9316e4b92753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:38.635843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be7a2-0c24-431d-96ae-9316e4b92753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.636269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be7a2-0c24-431d-96ae-9316e4b92753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.636656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98be7a2-0c24-431d-96ae-9316e4b92753 admin admin] PATH_INFO: `/v3/projects/3867a3f4c33f4f40aca7d359cb754c20/users/f94ee1b9bb9849b8b51cab578cb83eab/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.647356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be41c42-2cb6-4a08-8d3c-3bfe1633cc51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:38.655413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be41c42-2cb6-4a08-8d3c-3bfe1633cc51 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:38.667407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98be7a2-0c24-431d-96ae-9316e4b92753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3867a3f4c33f4f40aca7d359cb754c20, user_id=f94ee1b9bb9849b8b51cab578cb83eab, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:38.668186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98be7a2-0c24-431d-96ae-9316e4b92753 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:38.677315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 841/1706] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:38.678742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb9d22-2351-4c2f-bc1e-9a410cb1a197 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.679031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb9d22-2351-4c2f-bc1e-9a410cb1a197 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.679411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb9d22-2351-4c2f-bc1e-9a410cb1a197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.785898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 866/1707] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:38 2022] PUT /identity/v3/projects/3867a3f4c33f4f40aca7d359cb754c20/users/f94ee1b9bb9849b8b51cab578cb83eab/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:38.787786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823b0b-3182-4476-a1c2-879e46a62889 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.788537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823b0b-3182-4476-a1c2-879e46a62889 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.788997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823b0b-3182-4476-a1c2-879e46a62889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.815658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fcfb9d22-2351-4c2f-bc1e-9a410cb1a197 None None] MFA Rules not processed for user `3d5b15e9f0414836b3611a8ff6085b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:38.817881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fcfb9d22-2351-4c2f-bc1e-9a410cb1a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:38.863192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d6823b0b-3182-4476-a1c2-879e46a62889 None None] MFA Rules not processed for user `ab934520bd5e4a5e9c82fdfacbf99f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:38.864512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d6823b0b-3182-4476-a1c2-879e46a62889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:38.928228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 842/1708] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:38.947600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d436c-2c4c-4bc3-a025-7391b3446866 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:38.948772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d436c-2c4c-4bc3-a025-7391b3446866 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:38.948772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d436c-2c4c-4bc3-a025-7391b3446866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:38.990300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 867/1709] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:38.996453 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6823b0b-3182-4476-a1c2-879e46a62889 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:38.997938 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d6823b0b-3182-4476-a1c2-879e46a62889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:39.017349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d95d436c-2c4c-4bc3-a025-7391b3446866 None None] MFA Rules not processed for user `f94ee1b9bb9849b8b51cab578cb83eab`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:39.018659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d95d436c-2c4c-4bc3-a025-7391b3446866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:39.128039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6823b0b-3182-4476-a1c2-879e46a62889 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:39.132967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:39.133629 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.133931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.134429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] PATH_INFO: `/v3/projects/a7df6c3f1fad4357bac37b72661d549c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.137214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7df6c3f1fad4357bac37b72661d549c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:39.139420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:39.171375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:39.182107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 843/1710] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:39.183212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d436c-2c4c-4bc3-a025-7391b3446866 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:39.210526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d436c-2c4c-4bc3-a025-7391b3446866 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:39.216875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d550c-50ca-4370-8aef-4ae00690bd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:39.217947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d550c-50ca-4370-8aef-4ae00690bd05 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.218404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d550c-50ca-4370-8aef-4ae00690bd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.218833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d550c-50ca-4370-8aef-4ae00690bd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.230029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d550c-50ca-4370-8aef-4ae00690bd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:39.232357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d550c-50ca-4370-8aef-4ae00690bd05 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:39.250599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 844/1711] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:39.251893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d550c-50ca-4370-8aef-4ae00690bd05 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:39.267964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d550c-50ca-4370-8aef-4ae00690bd05 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:39.274267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83ee27-90a0-4538-8460-0af86813a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:39.275076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83ee27-90a0-4538-8460-0af86813a1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.286141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83ee27-90a0-4538-8460-0af86813a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.286141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83ee27-90a0-4538-8460-0af86813a1a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.286141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83ee27-90a0-4538-8460-0af86813a1a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:39.286141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83ee27-90a0-4538-8460-0af86813a1a1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:39.378496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7df6c3f1fad4357bac37b72661d549c', 'request_id': 'req-13bfe4ce-833d-4544-9682-dd99d0bb54bc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:39.395155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7df6c3f1fad4357bac37b72661d549c', 'request_id': 'req-13bfe4ce-833d-4544-9682-dd99d0bb54bc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:39.435559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 845/1712] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:39 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:39.435559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0beb0-fc1c-4015-bb6f-f847d0ec20f7 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.435559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0beb0-fc1c-4015-bb6f-f847d0ec20f7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.435559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0beb0-fc1c-4015-bb6f-f847d0ec20f7 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.440090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 846/1713] 10.222.0.61 () {54 vars in 912 bytes} [Tue Aug 23 16:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:34:39.443649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0beb0-fc1c-4015-bb6f-f847d0ec20f7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:39.501447 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7df6c3f1fad4357bac37b72661d549c', 'request_id': 'req-13bfe4ce-833d-4544-9682-dd99d0bb54bc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:39.520329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] The token cache is being invalidate because project a7df6c3f1fad4357bac37b72661d549c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:39.520329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:39.524445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-13bfe4ce-833d-4544-9682-dd99d0bb54bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:39.526495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 868/1714] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:38 2022] DELETE /identity/v3/projects/a7df6c3f1fad4357bac37b72661d549c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:39.530812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4af51-961a-4db0-b3cf-4824766c9d69 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.531103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4af51-961a-4db0-b3cf-4824766c9d69 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.531388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4af51-961a-4db0-b3cf-4824766c9d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.536556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:39.571983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0beb0-fc1c-4015-bb6f-f847d0ec20f7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:39.583606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:39.584272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.585059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.585059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.585694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:39.595237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:39.607402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-25e4af51-961a-4db0-b3cf-4824766c9d69 None None] MFA Rules not processed for user `3d5b15e9f0414836b3611a8ff6085b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:39.608685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-25e4af51-961a-4db0-b3cf-4824766c9d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:39.692071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 869/1715] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:39.693012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 847/1716] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:39 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:39.698633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:39.701798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:39.703363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27444-6f94-4ca0-8274-0c0fd73edbfa None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.703661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27444-6f94-4ca0-8274-0c0fd73edbfa None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.703942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f27444-6f94-4ca0-8274-0c0fd73edbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.731631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cd633-2502-4883-8d01-6fe9d2a1c690 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:39.737632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-64f27444-6f94-4ca0-8274-0c0fd73edbfa None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:39.739884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-64f27444-6f94-4ca0-8274-0c0fd73edbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:39.746194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0be28-8ac6-449d-bfdc-59fd7bd55545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:39.747078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0be28-8ac6-449d-bfdc-59fd7bd55545 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.747951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0be28-8ac6-449d-bfdc-59fd7bd55545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.748574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0be28-8ac6-449d-bfdc-59fd7bd55545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.749994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0be28-8ac6-449d-bfdc-59fd7bd55545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:39.771748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0be28-8ac6-449d-bfdc-59fd7bd55545 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:39.772192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 870/1717] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:39.773345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436679-a460-49d1-84af-7330bde3d8af None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.773755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436679-a460-49d1-84af-7330bde3d8af None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.774042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8436679-a460-49d1-84af-7330bde3d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.775033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 848/1718] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:39.797078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0be28-8ac6-449d-bfdc-59fd7bd55545 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:39.819426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f8436679-a460-49d1-84af-7330bde3d8af None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:39.820857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f8436679-a460-49d1-84af-7330bde3d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:39.825032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0be28-8ac6-449d-bfdc-59fd7bd55545 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:39.837736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 871/1719] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:39.847781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436679-a460-49d1-84af-7330bde3d8af None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:39.853524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63018efc-9f99-48c5-a74a-95acd0bc41f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:39.854299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018efc-9f99-48c5-a74a-95acd0bc41f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.854651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018efc-9f99-48c5-a74a-95acd0bc41f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.854998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018efc-9f99-48c5-a74a-95acd0bc41f5 admin admin] PATH_INFO: `/v3/projects/32be2f2ca3ae42af851957e5f39710c5/users/c862b3bc3c3c4d1990cd62aac7b9b06d/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.869739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8436679-a460-49d1-84af-7330bde3d8af None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:39.890095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:39.893784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.893784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.893784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.893784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:39.893784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:39.896805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:39.900662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63018efc-9f99-48c5-a74a-95acd0bc41f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32be2f2ca3ae42af851957e5f39710c5, user_id=c862b3bc3c3c4d1990cd62aac7b9b06d, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:39.904081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63018efc-9f99-48c5-a74a-95acd0bc41f5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:39.933826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 872/1720] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:39.933826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:39.936336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:39.953082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23894b-2305-4942-9017-fded03940cc1 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:39.957236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7fc94-b164-4402-947e-f378841792ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:39.957905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7fc94-b164-4402-947e-f378841792ee service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:39.958190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7fc94-b164-4402-947e-f378841792ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:39.958481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7fc94-b164-4402-947e-f378841792ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:39.966197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7fc94-b164-4402-947e-f378841792ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:39.967649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7fc94-b164-4402-947e-f378841792ee service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:39.977045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 873/1721] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:39.978041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7fc94-b164-4402-947e-f378841792ee service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:39.994137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7fc94-b164-4402-947e-f378841792ee service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:40.001339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5532-8ff6-4938-8341-b24c3a78775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:40.002812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5532-8ff6-4938-8341-b24c3a78775d admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.003166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5532-8ff6-4938-8341-b24c3a78775d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.003506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5532-8ff6-4938-8341-b24c3a78775d admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.004254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5532-8ff6-4938-8341-b24c3a78775d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:40.006300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a5532-8ff6-4938-8341-b24c3a78775d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:40.058667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 849/1722] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:39 2022] PUT /identity/v3/projects/32be2f2ca3ae42af851957e5f39710c5/users/c862b3bc3c3c4d1990cd62aac7b9b06d/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:40.062472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63018efc-9f99-48c5-a74a-95acd0bc41f5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:40.140388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 874/1723] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:39 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:40.149207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5532-8ff6-4938-8341-b24c3a78775d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:40.215036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63018efc-9f99-48c5-a74a-95acd0bc41f5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:40.311804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a5532-8ff6-4938-8341-b24c3a78775d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:40.313107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:40.314006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.314650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.315150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.316688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:40.318997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:40.340289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efe242-e978-4389-8227-2ddd791b13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:40.341155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe242-e978-4389-8227-2ddd791b13b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.341912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe242-e978-4389-8227-2ddd791b13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.343845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efe242-e978-4389-8227-2ddd791b13b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.347120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efe242-e978-4389-8227-2ddd791b13b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:40.356856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efe242-e978-4389-8227-2ddd791b13b7 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:40.358369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 850/1724] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:34:40.359805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:40.363146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:40.485508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7fa7b-fe70-4de1-a6ad-5f9a3d520d87 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:40.492641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1c8c-64de-4675-9d16-03cc1b6285c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:40.493705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1c8c-64de-4675-9d16-03cc1b6285c2 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.494008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1c8c-64de-4675-9d16-03cc1b6285c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.494166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1c8c-64de-4675-9d16-03cc1b6285c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.502936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 875/1725] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:40 2022] POST /identity/v3/users => generated 287 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:40.502936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efe242-e978-4389-8227-2ddd791b13b7 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:40.508741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a3df1c8c-64de-4675-9d16-03cc1b6285c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:40.521595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efe242-e978-4389-8227-2ddd791b13b7 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:40.537515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec82b-8839-4323-98aa-ebb419e3b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:40.537515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec82b-8839-4323-98aa-ebb419e3b4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.537515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec82b-8839-4323-98aa-ebb419e3b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.537515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec82b-8839-4323-98aa-ebb419e3b4e2 admin admin] PATH_INFO: `/v3/projects/32be2f2ca3ae42af851957e5f39710c5/users/c862b3bc3c3c4d1990cd62aac7b9b06d/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.543603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ec82b-8839-4323-98aa-ebb419e3b4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32be2f2ca3ae42af851957e5f39710c5, user_id=c862b3bc3c3c4d1990cd62aac7b9b06d, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:40.547095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ec82b-8839-4323-98aa-ebb419e3b4e2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:40.575901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 876/1726] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:40 2022] PUT /identity/v3/projects/32be2f2ca3ae42af851957e5f39710c5/users/c862b3bc3c3c4d1990cd62aac7b9b06d/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:40.592325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec277-a4ad-4378-aa1c-101a0d27c437 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.592325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec277-a4ad-4378-aa1c-101a0d27c437 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.592325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec277-a4ad-4378-aa1c-101a0d27c437 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.594995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 877/1727] 10.222.0.61 () {54 vars in 961 bytes} [Tue Aug 23 16:34:40 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:34:40.598966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec277-a4ad-4378-aa1c-101a0d27c437 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:40.643313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1c8c-64de-4675-9d16-03cc1b6285c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:40.645381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1c8c-64de-4675-9d16-03cc1b6285c2 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:40.674686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 851/1728] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:40.676504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ca752-6d8c-433c-bf59-5a66138b6712 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.677226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ca752-6d8c-433c-bf59-5a66138b6712 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.677665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ca752-6d8c-433c-bf59-5a66138b6712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.734049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec277-a4ad-4378-aa1c-101a0d27c437 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:40.748927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e635-2fdf-438a-8475-5fba8950617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:40.750165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e635-2fdf-438a-8475-5fba8950617b admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.750679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e635-2fdf-438a-8475-5fba8950617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.751091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e635-2fdf-438a-8475-5fba8950617b admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.751901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e635-2fdf-438a-8475-5fba8950617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:40.756335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e635-2fdf-438a-8475-5fba8950617b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:40.770881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4c0ca752-6d8c-433c-bf59-5a66138b6712 None None] MFA Rules not processed for user `c862b3bc3c3c4d1990cd62aac7b9b06d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:40.776016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4c0ca752-6d8c-433c-bf59-5a66138b6712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:40.810823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 878/1729] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:40.812476 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8ccf-3bb4-4f9d-b49a-f19c606adc8c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:40.812767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8ccf-3bb4-4f9d-b49a-f19c606adc8c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:40.813042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae8ccf-3bb4-4f9d-b49a-f19c606adc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:40.920797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-97ae8ccf-3bb4-4f9d-b49a-f19c606adc8c None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:40.922070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-97ae8ccf-3bb4-4f9d-b49a-f19c606adc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:40.946967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:41.035298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 852/1730] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:41.036207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ca752-6d8c-433c-bf59-5a66138b6712 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:41.063573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ca752-6d8c-433c-bf59-5a66138b6712 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:41.079035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc534c2-f4e9-4317-bf34-f8acf646c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:41.079781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc534c2-f4e9-4317-bf34-f8acf646c28b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:41.080064 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc534c2-f4e9-4317-bf34-f8acf646c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:41.080911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc534c2-f4e9-4317-bf34-f8acf646c28b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:41.081566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc534c2-f4e9-4317-bf34-f8acf646c28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:41.087001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc534c2-f4e9-4317-bf34-f8acf646c28b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:41.089034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 879/1731] 10.222.0.61 () {58 vars in 1058 bytes} [Tue Aug 23 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:41.090822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae8ccf-3bb4-4f9d-b49a-f19c606adc8c None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:41.095230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-97ae8ccf-3bb4-4f9d-b49a-f19c606adc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:41.114887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 853/1732] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:41.120660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc534c2-f4e9-4317-bf34-f8acf646c28b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:41.133307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae8ccf-3bb4-4f9d-b49a-f19c606adc8c None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:41.142280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc534c2-f4e9-4317-bf34-f8acf646c28b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:41.151010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:41.151654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:41.153581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:41.153949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:41.158840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:41.165876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:41.166807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:41.167252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:41.168067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:41.190839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:41.192532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:41.195121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:41.196597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:41.216549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 880/1733] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:41.221413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:41.244826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 854/1734] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:41.262131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cfabd-6e6a-466f-a2d1-5d047222ceb7 service placement] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:41.285210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:41.289193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:41.291482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:41.293408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] PATH_INFO: `/v3/projects/1e326f5ea7e74cbaacbab98879c13b6c/users/813db146d2434d42850e2c3553e924f5/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:41.344979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:41.346753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:41.366936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e326f5ea7e74cbaacbab98879c13b6c, user_id=813db146d2434d42850e2c3553e924f5, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:41.369662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:41.447756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:41.503191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b531c1-53bd-467e-ade4-06337dc9093e service placement] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:41.508958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d72b80-f725-4b07-aef8-d84bbe560c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:41.510100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72b80-f725-4b07-aef8-d84bbe560c04 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:41.510100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72b80-f725-4b07-aef8-d84bbe560c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:41.510322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d72b80-f725-4b07-aef8-d84bbe560c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:41.524845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d72b80-f725-4b07-aef8-d84bbe560c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:41.527284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d72b80-f725-4b07-aef8-d84bbe560c04 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:41.544033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 855/1735] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:34:41.562352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 881/1736] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:41 2022] PUT /identity/v3/projects/1e326f5ea7e74cbaacbab98879c13b6c/users/813db146d2434d42850e2c3553e924f5/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:41.569968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9244-4f7f-427e-9279-9bcabd7e4be3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:41.570380 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9244-4f7f-427e-9279-9bcabd7e4be3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:41.570793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9244-4f7f-427e-9279-9bcabd7e4be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:41.715561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ebcb9244-4f7f-427e-9279-9bcabd7e4be3 None None] MFA Rules not processed for user `813db146d2434d42850e2c3553e924f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:41.716968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ebcb9244-4f7f-427e-9279-9bcabd7e4be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:41.975631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 856/1737] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:41.986515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:41.988314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:42.085059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b3cb6-e6af-4a07-bbcc-f28e63a4d6a2 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:42.091192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc177a-9d77-4de0-a81b-a8e3467e0f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:42.091805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc177a-9d77-4de0-a81b-a8e3467e0f31 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:42.092354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc177a-9d77-4de0-a81b-a8e3467e0f31 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:42.092582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc177a-9d77-4de0-a81b-a8e3467e0f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:42.103142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc177a-9d77-4de0-a81b-a8e3467e0f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:42.104773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc177a-9d77-4de0-a81b-a8e3467e0f31 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:42.114872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 882/1738] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:42.477147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:42.651129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34217a9d-5182-4fb3-a7c6-7731c43767ea None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:42.652304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34217a9d-5182-4fb3-a7c6-7731c43767ea None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:42.652756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34217a9d-5182-4fb3-a7c6-7731c43767ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:42.721625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc177a-9d77-4de0-a81b-a8e3467e0f31 service nova] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:42.747152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-34217a9d-5182-4fb3-a7c6-7731c43767ea None None] MFA Rules not processed for user `ab934520bd5e4a5e9c82fdfacbf99f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:42.750948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-34217a9d-5182-4fb3-a7c6-7731c43767ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:42.872488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc177a-9d77-4de0-a81b-a8e3467e0f31 service nova] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:42.908867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:42.915437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:42.918928 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:42.918928 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] PATH_INFO: `/v3/users/813db146d2434d42850e2c3553e924f5` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:42.933867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=813db146d2434d42850e2c3553e924f5)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:42.936107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:42.961079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 857/1739] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:43.261891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813db146d2434d42850e2c3553e924f5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:43.263181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813db146d2434d42850e2c3553e924f5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:43.269260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813db146d2434d42850e2c3553e924f5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:43.427379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813db146d2434d42850e2c3553e924f5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:43.474199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efac1-c796-4eeb-a1fd-196e6fe90fcd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:43.474720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efac1-c796-4eeb-a1fd-196e6fe90fcd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:43.474793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367efac1-c796-4eeb-a1fd-196e6fe90fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:43.483158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813db146d2434d42850e2c3553e924f5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:43.519998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-367efac1-c796-4eeb-a1fd-196e6fe90fcd None None] MFA Rules not processed for user `7406a426e16a415e9c1f457f58a0871b`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:43.528077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-367efac1-c796-4eeb-a1fd-196e6fe90fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:43.530558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 883/1740] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:42 2022] DELETE /identity/v3/users/813db146d2434d42850e2c3553e924f5 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:34:43.531708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:43.537079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:43.652610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 858/1741] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:34:43.654681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735038-abfa-4843-b89e-3c86a0859410 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:43.654977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735038-abfa-4843-b89e-3c86a0859410 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:43.655256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735038-abfa-4843-b89e-3c86a0859410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:43.680616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a2735038-abfa-4843-b89e-3c86a0859410 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:43.682080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a2735038-abfa-4843-b89e-3c86a0859410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:43.772907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7925f-b808-4704-85c0-ef2bf015c505 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:43.780086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:43.780762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:43.781176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:43.781472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] PATH_INFO: `/v3/users/f94ee1b9bb9849b8b51cab578cb83eab` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:43.782738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94ee1b9bb9849b8b51cab578cb83eab)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:43.785511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:43.813918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 859/1742] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:43.840097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735038-abfa-4843-b89e-3c86a0859410 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:43.844259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a2735038-abfa-4843-b89e-3c86a0859410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:43.940188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735038-abfa-4843-b89e-3c86a0859410 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:43.947379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ce487-d023-49b6-a8e6-2ad52626bd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:43.948027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce487-d023-49b6-a8e6-2ad52626bd6b service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:43.948312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce487-d023-49b6-a8e6-2ad52626bd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:43.948587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ce487-d023-49b6-a8e6-2ad52626bd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:43.964926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ce487-d023-49b6-a8e6-2ad52626bd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:43.968545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ce487-d023-49b6-a8e6-2ad52626bd6b service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:44.005266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 860/1743] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:44.149093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94ee1b9bb9849b8b51cab578cb83eab'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:44.150863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94ee1b9bb9849b8b51cab578cb83eab'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:44.153836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94ee1b9bb9849b8b51cab578cb83eab'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:44.282128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94ee1b9bb9849b8b51cab578cb83eab'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:44.341477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94ee1b9bb9849b8b51cab578cb83eab'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:44.385762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 884/1744] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:43 2022] DELETE /identity/v3/users/f94ee1b9bb9849b8b51cab578cb83eab => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:44.396404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a513138-47d4-4480-b1e8-c0c71b5c0eee None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:44.396404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a513138-47d4-4480-b1e8-c0c71b5c0eee None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:44.396404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a513138-47d4-4480-b1e8-c0c71b5c0eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:44.416164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2a513138-47d4-4480-b1e8-c0c71b5c0eee None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:44.417851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2a513138-47d4-4480-b1e8-c0c71b5c0eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:44.534116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 861/1745] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:44.544138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:44.546144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:44.700413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a05e7-bfcb-4dea-bc52-7f092eaf2ec3 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:44.712970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0bffb-c26e-4b7f-ac2c-bae1db3a82de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:44.712970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bffb-c26e-4b7f-ac2c-bae1db3a82de service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:44.713259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bffb-c26e-4b7f-ac2c-bae1db3a82de service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:44.713491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bffb-c26e-4b7f-ac2c-bae1db3a82de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:44.729254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0bffb-c26e-4b7f-ac2c-bae1db3a82de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:44.740651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0bffb-c26e-4b7f-ac2c-bae1db3a82de service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:44.779554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 885/1746] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:45.124897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:45.238963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a513138-47d4-4480-b1e8-c0c71b5c0eee None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:45.241159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2a513138-47d4-4480-b1e8-c0c71b5c0eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:45.259427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a513138-47d4-4480-b1e8-c0c71b5c0eee None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:45.286537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:45.290661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:45.290661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:45.290661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] PATH_INFO: `/v3/projects/1e326f5ea7e74cbaacbab98879c13b6c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:45.290661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e326f5ea7e74cbaacbab98879c13b6c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:45.298342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:45.477949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:45.481661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e326f5ea7e74cbaacbab98879c13b6c', 'request_id': 'req-4df55393-c895-463d-a610-b20554ef576e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:45.591027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e326f5ea7e74cbaacbab98879c13b6c', 'request_id': 'req-4df55393-c895-463d-a610-b20554ef576e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:45.601001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e326f5ea7e74cbaacbab98879c13b6c', 'request_id': 'req-4df55393-c895-463d-a610-b20554ef576e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:45.633518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] The token cache is being invalidate because project 1e326f5ea7e74cbaacbab98879c13b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:45.633792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:45.634755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4df55393-c895-463d-a610-b20554ef576e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:45.647815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 862/1747] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:45 2022] DELETE /identity/v3/projects/1e326f5ea7e74cbaacbab98879c13b6c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:45.652959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4d51-a46f-4b00-8201-8645ea3b9cb1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:45.653510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4d51-a46f-4b00-8201-8645ea3b9cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:45.653510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4d51-a46f-4b00-8201-8645ea3b9cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:45.708590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-946c4d51-a46f-4b00-8201-8645ea3b9cb1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:45.710231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-946c4d51-a46f-4b00-8201-8645ea3b9cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:45.788776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 886/1748] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:45.796668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521767-2463-4860-adef-cb33ff27d653 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:45.796964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521767-2463-4860-adef-cb33ff27d653 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:45.797244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521767-2463-4860-adef-cb33ff27d653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:45.823394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4d51-a46f-4b00-8201-8645ea3b9cb1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:45.824850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-946c4d51-a46f-4b00-8201-8645ea3b9cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:45.860806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4d51-a46f-4b00-8201-8645ea3b9cb1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:45.865845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2a521767-2463-4860-adef-cb33ff27d653 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:45.869318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2a521767-2463-4860-adef-cb33ff27d653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:45.882359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:45.883187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:45.883458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:45.883824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] PATH_INFO: `/v3/projects/3867a3f4c33f4f40aca7d359cb754c20` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:45.884915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3867a3f4c33f4f40aca7d359cb754c20)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:45.887196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:45.901290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 863/1749] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:45.906631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a521767-2463-4860-adef-cb33ff27d653 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:45.936894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a521767-2463-4860-adef-cb33ff27d653 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:45.957426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:45.961594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:45.962080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:45.963437 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:45.966772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:45.967310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:45.973082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:46.006164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 864/1750] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:46.016281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:46.054831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3867a3f4c33f4f40aca7d359cb754c20', 'request_id': 'req-6622d745-d49e-4fa8-801c-570808502731'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.063373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ef0d1-2e00-488d-8b6b-553214ba6702 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:46.074082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3867a3f4c33f4f40aca7d359cb754c20', 'request_id': 'req-6622d745-d49e-4fa8-801c-570808502731'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.195814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3867a3f4c33f4f40aca7d359cb754c20', 'request_id': 'req-6622d745-d49e-4fa8-801c-570808502731'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.217375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] The token cache is being invalidate because project 3867a3f4c33f4f40aca7d359cb754c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:46.217820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.219954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.234416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 887/1751] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:45 2022] DELETE /identity/v3/projects/3867a3f4c33f4f40aca7d359cb754c20 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:46.235519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:46.247482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:46.260014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:46.261973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:46.268906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:46.268906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:46.268906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:46.268906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:46.279763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622d745-d49e-4fa8-801c-570808502731 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:46.295747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:46.296269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:46.303183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:46.303183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] PATH_INFO: `/v3/users/c862b3bc3c3c4d1990cd62aac7b9b06d` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:46.303183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c862b3bc3c3c4d1990cd62aac7b9b06d)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:46.305920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:46.486197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 865/1752] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:46 2022] POST /identity/v3/projects => generated 381 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:46.492406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:46.506884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:46.622353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c862b3bc3c3c4d1990cd62aac7b9b06d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.625597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c862b3bc3c3c4d1990cd62aac7b9b06d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.626632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c862b3bc3c3c4d1990cd62aac7b9b06d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.688218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34215761-239d-4d8f-9c9d-090248bdd217 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:46.694975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb50c0-1419-43dd-adda-db531b5ed28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:46.695647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb50c0-1419-43dd-adda-db531b5ed28b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:46.695927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb50c0-1419-43dd-adda-db531b5ed28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:46.696199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb50c0-1419-43dd-adda-db531b5ed28b admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:46.696882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb50c0-1419-43dd-adda-db531b5ed28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:46.699028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb50c0-1419-43dd-adda-db531b5ed28b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:46.730106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c862b3bc3c3c4d1990cd62aac7b9b06d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.758553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c862b3bc3c3c4d1990cd62aac7b9b06d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:46.789024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 888/1753] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:46 2022] DELETE /identity/v3/users/c862b3bc3c3c4d1990cd62aac7b9b06d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:46.847176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 866/1754] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:46 2022] POST /identity/v3/users => generated 291 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:46.851669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:46.853730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:46.940506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:47.025294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602938bb-4221-470a-ac21-49e6b03b4a27 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:47.036292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74d98-0184-414d-817f-28ca9b376c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:47.051216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74d98-0184-414d-817f-28ca9b376c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:47.052993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74d98-0184-414d-817f-28ca9b376c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:47.059796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74d98-0184-414d-817f-28ca9b376c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:47.062612 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e74d98-0184-414d-817f-28ca9b376c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:47.066342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e74d98-0184-414d-817f-28ca9b376c3c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:47.089673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb50c0-1419-43dd-adda-db531b5ed28b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:47.096945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 889/1755] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:34:47.103608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb50c0-1419-43dd-adda-db531b5ed28b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:47.114146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a71c2-8262-40dd-983d-3a85eb920b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:47.115095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a71c2-8262-40dd-983d-3a85eb920b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:47.115518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a71c2-8262-40dd-983d-3a85eb920b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:47.121371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a71c2-8262-40dd-983d-3a85eb920b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:47.121371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a71c2-8262-40dd-983d-3a85eb920b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:47.122645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a71c2-8262-40dd-983d-3a85eb920b6a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:47.153957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74d98-0184-414d-817f-28ca9b376c3c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:47.163709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 867/1756] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:34:47.170603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74d98-0184-414d-817f-28ca9b376c3c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:47.179296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6a5e-039c-44ba-b06f-9ee52789de9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:47.180521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6a5e-039c-44ba-b06f-9ee52789de9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:47.181026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6a5e-039c-44ba-b06f-9ee52789de9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:47.181532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b6a5e-039c-44ba-b06f-9ee52789de9e admin admin] PATH_INFO: `/v3/projects/1d47d1d4976f419b8e1b83d7db54a51e/users/247a9210969d46cf84046dc75fdb27eb/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:47.206332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b6a5e-039c-44ba-b06f-9ee52789de9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d47d1d4976f419b8e1b83d7db54a51e, user_id=247a9210969d46cf84046dc75fdb27eb, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:47.210983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b6a5e-039c-44ba-b06f-9ee52789de9e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:47.340406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:47.348722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 890/1757] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:47 2022] PUT /identity/v3/projects/1d47d1d4976f419b8e1b83d7db54a51e/users/247a9210969d46cf84046dc75fdb27eb/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:47.380863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bb25-718d-4732-a92f-c0b7a70adeb7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:47.381565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bb25-718d-4732-a92f-c0b7a70adeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:47.382257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9bb25-718d-4732-a92f-c0b7a70adeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:47.426832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f9d9bb25-718d-4732-a92f-c0b7a70adeb7 None None] MFA Rules not processed for user `247a9210969d46cf84046dc75fdb27eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:47.428298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f9d9bb25-718d-4732-a92f-c0b7a70adeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:47.673158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 868/1758] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:47.678390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6a5e-039c-44ba-b06f-9ee52789de9e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:47.829479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b6a5e-039c-44ba-b06f-9ee52789de9e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:47.839457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c725-414d-42fe-b952-011d939bd9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:47.840090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c725-414d-42fe-b952-011d939bd9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:47.840388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c725-414d-42fe-b952-011d939bd9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:47.840684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c725-414d-42fe-b952-011d939bd9e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:47.841377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675c725-414d-42fe-b952-011d939bd9e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:47.843894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675c725-414d-42fe-b952-011d939bd9e3 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:47.845038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2cc4-79f5-422e-bed6-a2ffbcc54aea None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:47.845487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2cc4-79f5-422e-bed6-a2ffbcc54aea None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:47.846502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2cc4-79f5-422e-bed6-a2ffbcc54aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:47.963083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 891/1759] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:47 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:47.964594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c725-414d-42fe-b952-011d939bd9e3 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:47.991555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5cac2cc4-79f5-422e-bed6-a2ffbcc54aea None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:47.993138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5cac2cc4-79f5-422e-bed6-a2ffbcc54aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:48.128943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:48.157401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c725-414d-42fe-b952-011d939bd9e3 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:48.163164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 869/1760] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:34:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:34:48.167652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a3dd9-efa0-43ec-a36e-ec141ec244b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:48.168609 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a3dd9-efa0-43ec-a36e-ec141ec244b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:48.169049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a3dd9-efa0-43ec-a36e-ec141ec244b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:48.169484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a3dd9-efa0-43ec-a36e-ec141ec244b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:48.171225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a3dd9-efa0-43ec-a36e-ec141ec244b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:48.191635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a3dd9-efa0-43ec-a36e-ec141ec244b2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:48.396582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 892/1761] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:47 2022] POST /identity/v3/users => generated 296 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:48.401073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac2cc4-79f5-422e-bed6-a2ffbcc54aea None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:48.421634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac2cc4-79f5-422e-bed6-a2ffbcc54aea None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:48.432745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:48.434256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:48.434628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:48.434977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:48.435729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:48.437560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:48.454447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 870/1762] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:48.459912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a3dd9-efa0-43ec-a36e-ec141ec244b2 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:48.475822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a3dd9-efa0-43ec-a36e-ec141ec244b2 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:48.478305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:48.482037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:48.494973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:48.498131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:48.498552 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:48.499078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] PATH_INFO: `/v3/projects/4dd0179b0429492fb947dfd0a85f82a5/users/7595fce798d2459c85429de6b71f2cd3/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:48.514843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9dba-148e-4143-a03d-acd574cc0f13 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:48.531288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:48.533312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:48.534931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:48.535212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] PATH_INFO: `/v3/projects/32be2f2ca3ae42af851957e5f39710c5` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:48.537482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32be2f2ca3ae42af851957e5f39710c5)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:48.541122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd0179b0429492fb947dfd0a85f82a5, user_id=7595fce798d2459c85429de6b71f2cd3, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:48.543390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:48.546999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:48.663523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 893/1763] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:48 2022] PUT /identity/v3/projects/4dd0179b0429492fb947dfd0a85f82a5/users/7595fce798d2459c85429de6b71f2cd3/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:48.665333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:48.667752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:48.748491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32be2f2ca3ae42af851957e5f39710c5', 'request_id': 'req-78b3d28d-8166-4340-a0bd-dc081d60cd1e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:48.873060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32be2f2ca3ae42af851957e5f39710c5', 'request_id': 'req-78b3d28d-8166-4340-a0bd-dc081d60cd1e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:48.891818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32be2f2ca3ae42af851957e5f39710c5', 'request_id': 'req-78b3d28d-8166-4340-a0bd-dc081d60cd1e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:48.911858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d73bc-573f-4dcf-b3de-736e7d1c0de7 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:48.918704 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] The token cache is being invalidate because project 32be2f2ca3ae42af851957e5f39710c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:48.919013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:48.919847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:48.930209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 871/1764] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:48 2022] DELETE /identity/v3/projects/32be2f2ca3ae42af851957e5f39710c5 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:48.930209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:48.936105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:49.084874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94d093-2e55-4f95-9820-4e9656518476 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:49.086118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d093-2e55-4f95-9820-4e9656518476 service swift] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:49.086752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d093-2e55-4f95-9820-4e9656518476 service swift] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:49.088469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d093-2e55-4f95-9820-4e9656518476 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:49.093169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ea94d093-2e55-4f95-9820-4e9656518476 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:49.112461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d28d-8166-4340-a0bd-dc081d60cd1e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:49.133023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac763ce-af53-4317-831f-a04141dee4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:49.139802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac763ce-af53-4317-831f-a04141dee4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:49.139802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac763ce-af53-4317-831f-a04141dee4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:49.139802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac763ce-af53-4317-831f-a04141dee4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:49.139802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac763ce-af53-4317-831f-a04141dee4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:49.146604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac763ce-af53-4317-831f-a04141dee4b9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:49.192654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 872/1765] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:49.198711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e71c6-c83b-4917-b73f-c8985e976ce9 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:49.199424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e71c6-c83b-4917-b73f-c8985e976ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:49.200980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e71c6-c83b-4917-b73f-c8985e976ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:49.246221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-210e71c6-c83b-4917-b73f-c8985e976ce9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:49.248114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-210e71c6-c83b-4917-b73f-c8985e976ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:49.262908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94d093-2e55-4f95-9820-4e9656518476 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:49.264469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94d093-2e55-4f95-9820-4e9656518476 service swift] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:49.274684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 873/1766] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:49.275866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e71c6-c83b-4917-b73f-c8985e976ce9 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:49.287538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e71c6-c83b-4917-b73f-c8985e976ce9 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:49.292680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720181aa-a832-4421-acb4-abc3fea24a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:49.293406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720181aa-a832-4421-acb4-abc3fea24a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:49.293726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720181aa-a832-4421-acb4-abc3fea24a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:49.294073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720181aa-a832-4421-acb4-abc3fea24a3b admin admin] PATH_INFO: `/v3/projects/4dd0179b0429492fb947dfd0a85f82a5/users/7595fce798d2459c85429de6b71f2cd3/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:49.294363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 894/1767] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:34:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:34:49.296087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1eb4d-e4ba-40c5-8f62-3fcbc9cc0db2 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:49.304534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1eb4d-e4ba-40c5-8f62-3fcbc9cc0db2 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:49.305444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1eb4d-e4ba-40c5-8f62-3fcbc9cc0db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:49.329644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720181aa-a832-4421-acb4-abc3fea24a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd0179b0429492fb947dfd0a85f82a5, user_id=7595fce798d2459c85429de6b71f2cd3, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:49.336411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720181aa-a832-4421-acb4-abc3fea24a3b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:49.410183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 874/1768] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:49 2022] PUT /identity/v3/projects/4dd0179b0429492fb947dfd0a85f82a5/users/7595fce798d2459c85429de6b71f2cd3/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:49.412593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7ae1eb4d-e4ba-40c5-8f62-3fcbc9cc0db2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:49.413860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7ae1eb4d-e4ba-40c5-8f62-3fcbc9cc0db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:49.425413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88370087-1962-4911-a92a-6583e487f97e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:49.425876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88370087-1962-4911-a92a-6583e487f97e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:49.426628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88370087-1962-4911-a92a-6583e487f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:49.551070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-88370087-1962-4911-a92a-6583e487f97e None None] MFA Rules not processed for user `7595fce798d2459c85429de6b71f2cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:49.555748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-88370087-1962-4911-a92a-6583e487f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:49.668527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:49.707301 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 895/1769] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:49.711158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1eb4d-e4ba-40c5-8f62-3fcbc9cc0db2 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:49.728982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1eb4d-e4ba-40c5-8f62-3fcbc9cc0db2 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:49.743391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:49.744601 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:49.745153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:49.746286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:49.747374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:49.747885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:49.750214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:49.754655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 875/1770] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:49.757021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:49.775225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88370087-1962-4911-a92a-6583e487f97e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:49.780906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-88370087-1962-4911-a92a-6583e487f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:49.800142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 896/1771] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:49.801528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:49.820156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb498bd8-f1fb-4f86-ab9d-21cba5c3c3ee admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:49.826403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5439361-7f04-4a20-94f5-49075ec80d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:49.827284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439361-7f04-4a20-94f5-49075ec80d38 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:49.827776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439361-7f04-4a20-94f5-49075ec80d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:49.828254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5439361-7f04-4a20-94f5-49075ec80d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:49.829321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5439361-7f04-4a20-94f5-49075ec80d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:49.832484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5439361-7f04-4a20-94f5-49075ec80d38 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:49.978969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 897/1772] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:49 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:49.988292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88370087-1962-4911-a92a-6583e487f97e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:49.989363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5439361-7f04-4a20-94f5-49075ec80d38 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:50.164532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b9be8-3013-4805-b440-d21f5d99a9a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:50.164532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9be8-3013-4805-b440-d21f5d99a9a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:50.164532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9be8-3013-4805-b440-d21f5d99a9a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:50.164532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9be8-3013-4805-b440-d21f5d99a9a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:50.224853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5439361-7f04-4a20-94f5-49075ec80d38 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:50.234149 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41572b0-091c-43d5-a744-45fec107d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:50.237979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41572b0-091c-43d5-a744-45fec107d07a admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:50.238583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41572b0-091c-43d5-a744-45fec107d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:50.239179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41572b0-091c-43d5-a744-45fec107d07a admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:50.240081 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41572b0-091c-43d5-a744-45fec107d07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:50.242383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41572b0-091c-43d5-a744-45fec107d07a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:50.394857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b9be8-3013-4805-b440-d21f5d99a9a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:50.402344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b9be8-3013-4805-b440-d21f5d99a9a8 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:50.441796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 876/1773] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:50.550891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 898/1774] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:49 2022] POST /identity/v3/users => generated 305 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:50.552314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b9be8-3013-4805-b440-d21f5d99a9a8 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:50.570345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b9be8-3013-4805-b440-d21f5d99a9a8 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:50.584868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bae142-fd1c-4598-9571-b095cfc490b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:50.584868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bae142-fd1c-4598-9571-b095cfc490b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:50.584868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bae142-fd1c-4598-9571-b095cfc490b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:50.584868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bae142-fd1c-4598-9571-b095cfc490b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:50.585273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bae142-fd1c-4598-9571-b095cfc490b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:50.586942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bae142-fd1c-4598-9571-b095cfc490b1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:50.636841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 877/1775] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:50.640589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41572b0-091c-43d5-a744-45fec107d07a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:50.654400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41572b0-091c-43d5-a744-45fec107d07a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:50.686119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:50.687941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:50.688973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:50.690193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:50.692776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:50.696163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:50.712645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 899/1776] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:50.716509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bae142-fd1c-4598-9571-b095cfc490b1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:50.761696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bae142-fd1c-4598-9571-b095cfc490b1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:50.772092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:50.775121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:50.777452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8732875-9de4-41a0-90a6-44ebac8cc8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:50.778384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8732875-9de4-41a0-90a6-44ebac8cc8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:50.781494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8732875-9de4-41a0-90a6-44ebac8cc8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:50.783667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8732875-9de4-41a0-90a6-44ebac8cc8e5 admin admin] PATH_INFO: `/v3/projects/b8d35710caa444b582f31b61a18e0296/users/a891038b8b8e42599a3b1ac619b4b4d0/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:50.798268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:50.801664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe2672-84ae-49dc-8bff-610a9bc9f0db admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:50.809019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e81348-cc25-489a-8624-ee8c7d070d67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:50.810089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81348-cc25-489a-8624-ee8c7d070d67 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:50.810632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81348-cc25-489a-8624-ee8c7d070d67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:50.811102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e81348-cc25-489a-8624-ee8c7d070d67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:50.813914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-40e81348-cc25-489a-8624-ee8c7d070d67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:50.830365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8732875-9de4-41a0-90a6-44ebac8cc8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d35710caa444b582f31b61a18e0296, user_id=a891038b8b8e42599a3b1ac619b4b4d0, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:50.838784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8732875-9de4-41a0-90a6-44ebac8cc8e5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:50.941829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 878/1777] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:50 2022] PUT /identity/v3/projects/b8d35710caa444b582f31b61a18e0296/users/a891038b8b8e42599a3b1ac619b4b4d0/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:50.944646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4d3a-94b4-4d07-b201-4291403d745a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:50.945174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4d3a-94b4-4d07-b201-4291403d745a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:50.945563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4d3a-94b4-4d07-b201-4291403d745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:50.945793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e81348-cc25-489a-8624-ee8c7d070d67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:50.947436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e81348-cc25-489a-8624-ee8c7d070d67 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:51.003644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8e5d4d3a-94b4-4d07-b201-4291403d745a None None] MFA Rules not processed for user `a891038b8b8e42599a3b1ac619b4b4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:51.005195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8e5d4d3a-94b4-4d07-b201-4291403d745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:51.005716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 900/1778] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:51.133889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b302d-edc5-45dd-b99f-17ddf01ef08d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:51.134405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b302d-edc5-45dd-b99f-17ddf01ef08d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:51.134835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b302d-edc5-45dd-b99f-17ddf01ef08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:51.169011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-866b302d-edc5-45dd-b99f-17ddf01ef08d None None] MFA Rules not processed for user `3d5b15e9f0414836b3611a8ff6085b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:51.171830 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-866b302d-edc5-45dd-b99f-17ddf01ef08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:51.206951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 879/1779] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:34:51.208197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d4d3a-94b4-4d07-b201-4291403d745a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:51.275058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 901/1780] 10.222.0.67 () {58 vars in 1015 bytes} [Tue Aug 23 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:51.337893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b302d-edc5-45dd-b99f-17ddf01ef08d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:51.347924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-866b302d-edc5-45dd-b99f-17ddf01ef08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:51.365246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b302d-edc5-45dd-b99f-17ddf01ef08d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:51.380935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d4997-a6bf-4177-87ab-9a7f3f9ebd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:51.382683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:51.389550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4997-a6bf-4177-87ab-9a7f3f9ebd72 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:51.389550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4997-a6bf-4177-87ab-9a7f3f9ebd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:51.389550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d4997-a6bf-4177-87ab-9a7f3f9ebd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:51.394263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d4d3a-94b4-4d07-b201-4291403d745a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:51.406617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d4997-a6bf-4177-87ab-9a7f3f9ebd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:51.408037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d4997-a6bf-4177-87ab-9a7f3f9ebd72 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:51.408880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69381c-79cd-4b21-b6cd-2b2bb82f567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:51.409582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69381c-79cd-4b21-b6cd-2b2bb82f567c admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:51.409891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69381c-79cd-4b21-b6cd-2b2bb82f567c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:51.410168 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69381c-79cd-4b21-b6cd-2b2bb82f567c admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:51.412847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69381c-79cd-4b21-b6cd-2b2bb82f567c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:51.415012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69381c-79cd-4b21-b6cd-2b2bb82f567c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:51.428670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 902/1781] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:34:51.464774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:51.520384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 880/1782] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:51 2022] POST /identity/v3/projects => generated 407 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:51.523164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d4997-a6bf-4177-87ab-9a7f3f9ebd72 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:51.542431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d4997-a6bf-4177-87ab-9a7f3f9ebd72 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:51.662068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0648f0-c3e3-42a4-ac75-ab1fbd7a4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:51.664100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0648f0-c3e3-42a4-ac75-ab1fbd7a4ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:51.664801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0648f0-c3e3-42a4-ac75-ab1fbd7a4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:51.665840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0648f0-c3e3-42a4-ac75-ab1fbd7a4ecd admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:51.666927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0648f0-c3e3-42a4-ac75-ab1fbd7a4ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:51.671619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0648f0-c3e3-42a4-ac75-ab1fbd7a4ecd admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:51.826023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 903/1783] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:51 2022] POST /identity/v3/users => generated 310 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:51.829976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69381c-79cd-4b21-b6cd-2b2bb82f567c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:51.855239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69381c-79cd-4b21-b6cd-2b2bb82f567c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:51.872426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:51.873728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:51.873916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:51.874215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:51.875008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:51.879526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:51.950636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0648f0-c3e3-42a4-ac75-ab1fbd7a4ecd admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:51.962886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0648f0-c3e3-42a4-ac75-ab1fbd7a4ecd admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:51.966419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 881/1784] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:51.984228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e969-652f-4624-b704-2b34ad7592ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:51.984958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e969-652f-4624-b704-2b34ad7592ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:51.985253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e969-652f-4624-b704-2b34ad7592ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:51.985627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05e969-652f-4624-b704-2b34ad7592ad admin admin] PATH_INFO: `/v3/projects/6b2b687813604b2d990e7b6f12afaf46/users/d53082470c454aea9196e67c66801cc2/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:52.036848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05e969-652f-4624-b704-2b34ad7592ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2b687813604b2d990e7b6f12afaf46, user_id=d53082470c454aea9196e67c66801cc2, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:52.051644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05e969-652f-4624-b704-2b34ad7592ad admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:52.128757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:52.131203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:52.157728 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 904/1785] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:51 2022] PUT /identity/v3/projects/6b2b687813604b2d990e7b6f12afaf46/users/d53082470c454aea9196e67c66801cc2/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:52.162268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e969-652f-4624-b704-2b34ad7592ad admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:52.167035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba638f5-8d0a-4a4b-9c88-de0440e88f71 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:52.202165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:52.338557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05e969-652f-4624-b704-2b34ad7592ad admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:52.344950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:52.346588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aef93-ccb7-4ce9-b635-07e8f6124ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:52.346725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:52.346725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:52.346725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] PATH_INFO: `/v3/users/21647f2da45b460ca1655602a4c5f98b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:52.347350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aef93-ccb7-4ce9-b635-07e8f6124ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:52.348196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21647f2da45b460ca1655602a4c5f98b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:52.348332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aef93-ccb7-4ce9-b635-07e8f6124ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:52.348782 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aef93-ccb7-4ce9-b635-07e8f6124ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:52.351545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29aef93-ccb7-4ce9-b635-07e8f6124ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:52.353677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29aef93-ccb7-4ce9-b635-07e8f6124ee4 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:52.359057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:52.391223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 905/1786] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:52.394724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aef93-ccb7-4ce9-b635-07e8f6124ee4 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:52.441806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aef93-ccb7-4ce9-b635-07e8f6124ee4 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:52.442497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655949-4e6a-45d2-90dc-8e4b6b352d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:52.443355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655949-4e6a-45d2-90dc-8e4b6b352d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:52.443780 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655949-4e6a-45d2-90dc-8e4b6b352d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:52.444129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655949-4e6a-45d2-90dc-8e4b6b352d33 admin admin] PATH_INFO: `/v3/projects/6b2b687813604b2d990e7b6f12afaf46/users/d53082470c454aea9196e67c66801cc2/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:52.446578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87655949-4e6a-45d2-90dc-8e4b6b352d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2b687813604b2d990e7b6f12afaf46, user_id=d53082470c454aea9196e67c66801cc2, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:52.449897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87655949-4e6a-45d2-90dc-8e4b6b352d33 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:52.490226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 906/1787] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:52 2022] PUT /identity/v3/projects/6b2b687813604b2d990e7b6f12afaf46/users/d53082470c454aea9196e67c66801cc2/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:52.494770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271756e-4f18-4fde-ad24-791965f38912 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:52.495067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271756e-4f18-4fde-ad24-791965f38912 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:52.495344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271756e-4f18-4fde-ad24-791965f38912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:52.584787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2271756e-4f18-4fde-ad24-791965f38912 None None] MFA Rules not processed for user `d53082470c454aea9196e67c66801cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:52.587246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2271756e-4f18-4fde-ad24-791965f38912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:52.676682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21647f2da45b460ca1655602a4c5f98b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:52.770921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 907/1788] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:52.770921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271756e-4f18-4fde-ad24-791965f38912 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:52.771113 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21647f2da45b460ca1655602a4c5f98b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:52.771113 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21647f2da45b460ca1655602a4c5f98b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:52.771113 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21647f2da45b460ca1655602a4c5f98b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:52.826343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21647f2da45b460ca1655602a4c5f98b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:52.892317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271756e-4f18-4fde-ad24-791965f38912 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:52.916584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ee620-3acf-48d0-94f2-6d33ec741936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:52.918232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ee620-3acf-48d0-94f2-6d33ec741936 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:52.920383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ee620-3acf-48d0-94f2-6d33ec741936 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:52.920883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ee620-3acf-48d0-94f2-6d33ec741936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:52.937957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e22ee620-3acf-48d0-94f2-6d33ec741936 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:52.987179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ee620-3acf-48d0-94f2-6d33ec741936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:52.990737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ee620-3acf-48d0-94f2-6d33ec741936 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:53.038031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 908/1789] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:52 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:53.189038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 882/1790] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:52 2022] DELETE /identity/v3/users/21647f2da45b460ca1655602a4c5f98b => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:34:53.191550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df61f0-20c2-412e-a1d5-8c80d0a02802 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:53.191823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df61f0-20c2-412e-a1d5-8c80d0a02802 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:53.192105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df61f0-20c2-412e-a1d5-8c80d0a02802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:53.253210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-11df61f0-20c2-412e-a1d5-8c80d0a02802 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:53.254821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-11df61f0-20c2-412e-a1d5-8c80d0a02802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:53.407776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 909/1791] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:53.488727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:53.490255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:53.573249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bf768-8686-4d9d-b1b2-d76adffcf170 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:53.598623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4ea22-64ad-42b7-b6d7-50d830f03cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:53.599409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4ea22-64ad-42b7-b6d7-50d830f03cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:53.599824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4ea22-64ad-42b7-b6d7-50d830f03cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:53.600198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4ea22-64ad-42b7-b6d7-50d830f03cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:53.627600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4ea22-64ad-42b7-b6d7-50d830f03cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:53.629811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4ea22-64ad-42b7-b6d7-50d830f03cc8 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:53.662995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 883/1792] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:54.376133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df61f0-20c2-412e-a1d5-8c80d0a02802 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:54.378820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-11df61f0-20c2-412e-a1d5-8c80d0a02802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:54.613727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:54.613727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df61f0-20c2-412e-a1d5-8c80d0a02802 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:54.630762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa25e36-ae4a-4395-b916-51331ad98922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:54.631457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa25e36-ae4a-4395-b916-51331ad98922 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:54.631743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa25e36-ae4a-4395-b916-51331ad98922 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:54.632022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa25e36-ae4a-4395-b916-51331ad98922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:54.638837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-baa25e36-ae4a-4395-b916-51331ad98922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:54.809596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa25e36-ae4a-4395-b916-51331ad98922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:54.811184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa25e36-ae4a-4395-b916-51331ad98922 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:54.876001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635f8c-9d06-49e3-a19d-0d4c2e0b58ba None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:54.876653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635f8c-9d06-49e3-a19d-0d4c2e0b58ba None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:54.876653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635f8c-9d06-49e3-a19d-0d4c2e0b58ba None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:54.877191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 910/1793] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:54.878774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 884/1794] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:34:54.888162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11618b6-5bed-49c9-b8d0-618683d2ff98 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:54.888484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11618b6-5bed-49c9-b8d0-618683d2ff98 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:54.888779 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11618b6-5bed-49c9-b8d0-618683d2ff98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:54.995005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d11618b6-5bed-49c9-b8d0-618683d2ff98 None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:54.999676 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d11618b6-5bed-49c9-b8d0-618683d2ff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:55.160901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 911/1795] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:55.828591 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63635f8c-9d06-49e3-a19d-0d4c2e0b58ba None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:55.830583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-63635f8c-9d06-49e3-a19d-0d4c2e0b58ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:55.879259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63635f8c-9d06-49e3-a19d-0d4c2e0b58ba None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:55.893839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:55.896719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:55.898804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:55.899336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:55.922382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:55.928986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:55.941167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 885/1796] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:56.021885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:56.267064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10121-b5f7-4030-bc02-0ed225917928 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:56.269916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10121-b5f7-4030-bc02-0ed225917928 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:56.270284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f10121-b5f7-4030-bc02-0ed225917928 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:56.271919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 912/1797] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:34:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:34:56.281415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:56.283895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:56.310195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2cca2-b911-4ba6-a874-b3948535a017 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:56.316446 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62607a9c-1baf-4ad2-bf9b-e769941edf1c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:56.317023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62607a9c-1baf-4ad2-bf9b-e769941edf1c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:56.317500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62607a9c-1baf-4ad2-bf9b-e769941edf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:56.318126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:56.319876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:56.320553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:56.321564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] PATH_INFO: `/v3/projects/ad9f660cd2aa4aeab90b7ba324299463` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:56.324533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9f660cd2aa4aeab90b7ba324299463)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:56.337931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:56.345415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-62607a9c-1baf-4ad2-bf9b-e769941edf1c None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:56.347427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-62607a9c-1baf-4ad2-bf9b-e769941edf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:56.363352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 913/1798] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:34:56.563319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9f660cd2aa4aeab90b7ba324299463', 'request_id': 'req-e0a50778-bea6-4a5f-a84b-c79c5faee497'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:56.678653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9f660cd2aa4aeab90b7ba324299463', 'request_id': 'req-e0a50778-bea6-4a5f-a84b-c79c5faee497'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:56.706107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9f660cd2aa4aeab90b7ba324299463', 'request_id': 'req-e0a50778-bea6-4a5f-a84b-c79c5faee497'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:56.724968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] The token cache is being invalidate because project ad9f660cd2aa4aeab90b7ba324299463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:56.728382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:56.728382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:56.729098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 886/1799] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:56 2022] DELETE /identity/v3/projects/ad9f660cd2aa4aeab90b7ba324299463 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:56.732841 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62607a9c-1baf-4ad2-bf9b-e769941edf1c None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:56.758922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62607a9c-1baf-4ad2-bf9b-e769941edf1c None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:56.810837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:56.812393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:56.900505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:56.900505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:56.900505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:56.900505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] PATH_INFO: `/v3/users/1184c80bb7e64e60835b125f68691d81` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:56.901105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1184c80bb7e64e60835b125f68691d81)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:56.903392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:56.951053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a50778-bea6-4a5f-a84b-c79c5faee497 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:56.958897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:56.960561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:56.960857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:56.961217 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:56.966288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:57.006442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:57.009092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:57.047862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 887/1800] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:34:57.161954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1184c80bb7e64e60835b125f68691d81'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:57.163213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1184c80bb7e64e60835b125f68691d81'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:57.163868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1184c80bb7e64e60835b125f68691d81'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:57.242426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1184c80bb7e64e60835b125f68691d81'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:57.262815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-452106f8-3592-4404-a10e-4c4efd9bddf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1184c80bb7e64e60835b125f68691d81'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:57.284310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 914/1801] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:56 2022] DELETE /identity/v3/users/1184c80bb7e64e60835b125f68691d81 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:58.566272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:58.572284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:58.584418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fd349-4cf7-4b1c-bb3c-8cef6fd62873 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:58.657449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:58.658909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:58.659382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:58.659828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] PATH_INFO: `/v3/projects/020b46fac9da4b59ac3ec40862485582` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:58.661417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=020b46fac9da4b59ac3ec40862485582)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:58.663559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:58.874769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020b46fac9da4b59ac3ec40862485582', 'request_id': 'req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:58.957544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020b46fac9da4b59ac3ec40862485582', 'request_id': 'req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:58.968365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020b46fac9da4b59ac3ec40862485582', 'request_id': 'req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:58.989467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] The token cache is being invalidate because project 020b46fac9da4b59ac3ec40862485582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:58.993824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:59.002128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5fa5a656-0c9a-48d9-a95c-39b3928c22dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:59.010736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 888/1802] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:58 2022] DELETE /identity/v3/projects/020b46fac9da4b59ac3ec40862485582 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:59.018343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e43ff-dd0a-4a56-8d4a-0cc8e558aaf1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:59.018343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e43ff-dd0a-4a56-8d4a-0cc8e558aaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:59.018343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e43ff-dd0a-4a56-8d4a-0cc8e558aaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:59.050442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-cb5e43ff-dd0a-4a56-8d4a-0cc8e558aaf1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:59.052271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cb5e43ff-dd0a-4a56-8d4a-0cc8e558aaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:59.155747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 915/1803] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:59.164284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123efd0-c267-4a7c-bd2e-4e49cfe0794a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:59.164872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123efd0-c267-4a7c-bd2e-4e49cfe0794a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:59.165150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123efd0-c267-4a7c-bd2e-4e49cfe0794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:59.186162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8123efd0-c267-4a7c-bd2e-4e49cfe0794a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:34:59.187654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8123efd0-c267-4a7c-bd2e-4e49cfe0794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:59.204313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e43ff-dd0a-4a56-8d4a-0cc8e558aaf1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:59.204943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 889/1804] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:34:59.220849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e43ff-dd0a-4a56-8d4a-0cc8e558aaf1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:59.226384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:59.227639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:59.228248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:59.228785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:59.234066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:34:59.234066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:59.234066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:59.250026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123efd0-c267-4a7c-bd2e-4e49cfe0794a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:59.264376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 916/1805] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:34:59.264474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123efd0-c267-4a7c-bd2e-4e49cfe0794a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:59.272721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15cec2-a2fb-4f48-b2b2-7dd3d5b976c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:59.273869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cec2-a2fb-4f48-b2b2-7dd3d5b976c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:59.274335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cec2-a2fb-4f48-b2b2-7dd3d5b976c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:59.274809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15cec2-a2fb-4f48-b2b2-7dd3d5b976c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:59.275721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15cec2-a2fb-4f48-b2b2-7dd3d5b976c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:59.303556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15cec2-a2fb-4f48-b2b2-7dd3d5b976c6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:59.429270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 890/1806] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:34:59 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:34:59.433396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:59.448601 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893583-7f92-41c8-a798-85658b2f19bb admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:59.569346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc5830-83d6-4cba-b94d-07b21d570ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:59.570159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5830-83d6-4cba-b94d-07b21d570ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:59.570638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5830-83d6-4cba-b94d-07b21d570ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:59.570925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5830-83d6-4cba-b94d-07b21d570ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:59.571947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc5830-83d6-4cba-b94d-07b21d570ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:59.575140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc5830-83d6-4cba-b94d-07b21d570ba8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:59.677456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 917/1807] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:34:59 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:34:59.682071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15cec2-a2fb-4f48-b2b2-7dd3d5b976c6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:59.694896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15cec2-a2fb-4f48-b2b2-7dd3d5b976c6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:59.701093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f03f9a-8df9-402f-9bd0-e22640731dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:59.701828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03f9a-8df9-402f-9bd0-e22640731dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:59.702049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03f9a-8df9-402f-9bd0-e22640731dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:59.702324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03f9a-8df9-402f-9bd0-e22640731dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:59.702976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f03f9a-8df9-402f-9bd0-e22640731dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:59.704676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f03f9a-8df9-402f-9bd0-e22640731dd9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:59.727446 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 891/1808] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:59.734228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc5830-83d6-4cba-b94d-07b21d570ba8 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:59.753300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc5830-83d6-4cba-b94d-07b21d570ba8 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:59.765054 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61bd59-4585-4d19-a2cf-180620d39d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:59.765901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61bd59-4585-4d19-a2cf-180620d39d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:59.766196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61bd59-4585-4d19-a2cf-180620d39d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:59.766501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61bd59-4585-4d19-a2cf-180620d39d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:59.770880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61bd59-4585-4d19-a2cf-180620d39d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:59.772426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61bd59-4585-4d19-a2cf-180620d39d0f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:59.796785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 918/1809] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:34:59.800425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f03f9a-8df9-402f-9bd0-e22640731dd9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:59.811829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f03f9a-8df9-402f-9bd0-e22640731dd9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:59.817770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9df7e5-88ac-4c66-8638-066740ddc25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:59.818807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df7e5-88ac-4c66-8638-066740ddc25d admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:59.819389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df7e5-88ac-4c66-8638-066740ddc25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:59.820075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df7e5-88ac-4c66-8638-066740ddc25d admin admin] PATH_INFO: `/v3/projects/ca78acee8ad941989513d7d027fd6199/users/e398da31347a4b3ea1af9ed08b07c8da/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:59.841589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9df7e5-88ac-4c66-8638-066740ddc25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca78acee8ad941989513d7d027fd6199, user_id=e398da31347a4b3ea1af9ed08b07c8da, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:59.844978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9df7e5-88ac-4c66-8638-066740ddc25d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:00.350551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 892/1810] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:34:59 2022] PUT /identity/v3/projects/ca78acee8ad941989513d7d027fd6199/users/e398da31347a4b3ea1af9ed08b07c8da/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:00.361191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8739-4617-4e5f-83ef-3fb81fbf9968 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:00.362343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8739-4617-4e5f-83ef-3fb81fbf9968 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:00.362343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8739-4617-4e5f-83ef-3fb81fbf9968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:00.394585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-70ff8739-4617-4e5f-83ef-3fb81fbf9968 None None] MFA Rules not processed for user `e398da31347a4b3ea1af9ed08b07c8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:00.398620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-70ff8739-4617-4e5f-83ef-3fb81fbf9968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:00.480582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:00.515725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 919/1811] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:00.520927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9df7e5-88ac-4c66-8638-066740ddc25d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:00.604347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9df7e5-88ac-4c66-8638-066740ddc25d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:00.609144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086602c-fef5-48e4-98bd-769771802880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:00.609786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086602c-fef5-48e4-98bd-769771802880 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:00.610070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086602c-fef5-48e4-98bd-769771802880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:00.610342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086602c-fef5-48e4-98bd-769771802880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:00.610968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086602c-fef5-48e4-98bd-769771802880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:00.612947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086602c-fef5-48e4-98bd-769771802880 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:00.708553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:00.719602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 893/1812] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:00 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:00.724628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8739-4617-4e5f-83ef-3fb81fbf9968 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:00.736897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8739-4617-4e5f-83ef-3fb81fbf9968 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:00.803310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2f5ef-110d-4cee-9bec-8b783cc20180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:00.803924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f5ef-110d-4cee-9bec-8b783cc20180 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:00.804207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f5ef-110d-4cee-9bec-8b783cc20180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:00.804489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f5ef-110d-4cee-9bec-8b783cc20180 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:00.805125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2f5ef-110d-4cee-9bec-8b783cc20180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:00.807265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2f5ef-110d-4cee-9bec-8b783cc20180 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:00.913432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 920/1813] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:00 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:00.914915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086602c-fef5-48e4-98bd-769771802880 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:00.925383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086602c-fef5-48e4-98bd-769771802880 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:00.930155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56511ee5-6cd3-4299-ad1f-af89fdc41806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:00.930750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511ee5-6cd3-4299-ad1f-af89fdc41806 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:00.931035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511ee5-6cd3-4299-ad1f-af89fdc41806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:00.931360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56511ee5-6cd3-4299-ad1f-af89fdc41806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:00.932002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56511ee5-6cd3-4299-ad1f-af89fdc41806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:00.933576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56511ee5-6cd3-4299-ad1f-af89fdc41806 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:00.944701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 894/1814] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:00.948940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2f5ef-110d-4cee-9bec-8b783cc20180 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:00.959666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2f5ef-110d-4cee-9bec-8b783cc20180 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:00.964398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee73f39-b3c7-44c4-b607-6678c5f71254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:00.965054 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73f39-b3c7-44c4-b607-6678c5f71254 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:00.965335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73f39-b3c7-44c4-b607-6678c5f71254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:00.965626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee73f39-b3c7-44c4-b607-6678c5f71254 admin admin] PATH_INFO: `/v3/projects/b7c64aa5a58a4e069f309a6507021699/users/7a29d3546f6349098013f6726cbd4378/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:00.980386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee73f39-b3c7-44c4-b607-6678c5f71254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c64aa5a58a4e069f309a6507021699, user_id=7a29d3546f6349098013f6726cbd4378, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:00.983115 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee73f39-b3c7-44c4-b607-6678c5f71254 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:01.065413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 921/1815] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:00 2022] PUT /identity/v3/projects/b7c64aa5a58a4e069f309a6507021699/users/7a29d3546f6349098013f6726cbd4378/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:01.069440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56511ee5-6cd3-4299-ad1f-af89fdc41806 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:01.080890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56511ee5-6cd3-4299-ad1f-af89fdc41806 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:01.137848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74023a99-19bc-458a-a7d6-485f21a56c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:01.138483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74023a99-19bc-458a-a7d6-485f21a56c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:01.143601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74023a99-19bc-458a-a7d6-485f21a56c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:01.143601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74023a99-19bc-458a-a7d6-485f21a56c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:01.143601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74023a99-19bc-458a-a7d6-485f21a56c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:01.143601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74023a99-19bc-458a-a7d6-485f21a56c32 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:01.152275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 895/1816] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:01.156464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee73f39-b3c7-44c4-b607-6678c5f71254 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:01.168189 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee73f39-b3c7-44c4-b607-6678c5f71254 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:01.172977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:01.173637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:01.173925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:01.174314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] PATH_INFO: `/v3/projects/b7c64aa5a58a4e069f309a6507021699/users/7a29d3546f6349098013f6726cbd4378/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:01.176265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c64aa5a58a4e069f309a6507021699, user_id=7a29d3546f6349098013f6726cbd4378, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:01.178915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:01.188940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 922/1817] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:01 2022] PUT /identity/v3/projects/b7c64aa5a58a4e069f309a6507021699/users/7a29d3546f6349098013f6726cbd4378/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:01.200865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc891bae-79cd-41a7-af84-c34bd4401673 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:01.201151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc891bae-79cd-41a7-af84-c34bd4401673 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:01.201425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc891bae-79cd-41a7-af84-c34bd4401673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:01.231103 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bc891bae-79cd-41a7-af84-c34bd4401673 None None] MFA Rules not processed for user `7a29d3546f6349098013f6726cbd4378`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:01.232331 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bc891bae-79cd-41a7-af84-c34bd4401673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:01.337636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 896/1818] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:01.338275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:01.339976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:01.446308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a841bd-d4c4-460e-b9d2-92f6f934ef82 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:01.453396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:01.454178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:01.454535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:01.455085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:01.470646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:01.472604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:01.501997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 923/1819] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:04.988616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:04.989202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc891bae-79cd-41a7-af84-c34bd4401673 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:05.054182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:05.058009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc891bae-79cd-41a7-af84-c34bd4401673 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:05.068478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:05.068478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:05.068478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:05.068478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] PATH_INFO: `/v3/users/e398da31347a4b3ea1af9ed08b07c8da` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:05.068896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e398da31347a4b3ea1af9ed08b07c8da)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:05.068896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:05.313680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e398da31347a4b3ea1af9ed08b07c8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.322680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e398da31347a4b3ea1af9ed08b07c8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.324081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e398da31347a4b3ea1af9ed08b07c8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.324927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e398da31347a4b3ea1af9ed08b07c8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.326471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:05.327817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:05.338245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54c4d2dd-f47a-4e45-a83a-9c5b188eaac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e398da31347a4b3ea1af9ed08b07c8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.345338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881182f6-c74d-4759-859b-974fa667a572 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:05.350062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:05.350696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:05.350979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:05.351253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] PATH_INFO: `/v3/users/247a9210969d46cf84046dc75fdb27eb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:05.352378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=247a9210969d46cf84046dc75fdb27eb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:05.354330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:05.407645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 897/1820] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:04 2022] DELETE /identity/v3/users/e398da31347a4b3ea1af9ed08b07c8da => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:05.412764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8aece-177c-4eac-9097-ec583d1c130e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:05.413051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8aece-177c-4eac-9097-ec583d1c130e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:05.413326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8aece-177c-4eac-9097-ec583d1c130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:05.432727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d9c8aece-177c-4eac-9097-ec583d1c130e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:05.435599 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9c8aece-177c-4eac-9097-ec583d1c130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:05.494638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 898/1821] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:05.505099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8aece-177c-4eac-9097-ec583d1c130e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:05.506306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9c8aece-177c-4eac-9097-ec583d1c130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:05.567222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247a9210969d46cf84046dc75fdb27eb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.568006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247a9210969d46cf84046dc75fdb27eb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.568637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247a9210969d46cf84046dc75fdb27eb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.572246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8aece-177c-4eac-9097-ec583d1c130e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:05.576777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f56ab-e424-483b-ab1e-5cf8619f088f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:05.577464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f56ab-e424-483b-ab1e-5cf8619f088f service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:05.577790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f56ab-e424-483b-ab1e-5cf8619f088f service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:05.579092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f56ab-e424-483b-ab1e-5cf8619f088f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:05.580051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a95f56ab-e424-483b-ab1e-5cf8619f088f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:05.592654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f56ab-e424-483b-ab1e-5cf8619f088f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:05.594166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f56ab-e424-483b-ab1e-5cf8619f088f service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:05.607424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 899/1822] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:05.692097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247a9210969d46cf84046dc75fdb27eb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.711989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247a9210969d46cf84046dc75fdb27eb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:05.728730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 924/1823] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:05 2022] DELETE /identity/v3/users/247a9210969d46cf84046dc75fdb27eb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:05.734127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0816a-d855-4f13-882f-a70b69aced36 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:05.734862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0816a-d855-4f13-882f-a70b69aced36 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:05.735519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0816a-d855-4f13-882f-a70b69aced36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:05.755854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d1f0816a-d855-4f13-882f-a70b69aced36 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:05.761777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d1f0816a-d855-4f13-882f-a70b69aced36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:05.819767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:05.819767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:05.846598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 900/1824] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:05.880480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0816a-d855-4f13-882f-a70b69aced36 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:05.882147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d1f0816a-d855-4f13-882f-a70b69aced36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:05.907593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab8dce-1249-4b44-bae0-c912ce628e4f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:05.913209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:05.913965 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:05.915088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:05.915088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] PATH_INFO: `/v3/users/a891038b8b8e42599a3b1ac619b4b4d0` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:05.916480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a891038b8b8e42599a3b1ac619b4b4d0)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:05.919064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:05.945117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0816a-d855-4f13-882f-a70b69aced36 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:05.948946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:05.949789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:05.950070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:05.950344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:05.960268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:05.961728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:05.971857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 901/1825] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:06.102943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:06.104386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:06.117208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ada811-7d83-4cfa-bb3c-1c8131891325 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:06.122191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:06.122826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:06.123277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:06.123811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] PATH_INFO: `/v3/projects/ca78acee8ad941989513d7d027fd6199` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:06.125296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca78acee8ad941989513d7d027fd6199)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:06.128048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:06.163541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a891038b8b8e42599a3b1ac619b4b4d0'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.164634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a891038b8b8e42599a3b1ac619b4b4d0'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.165258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a891038b8b8e42599a3b1ac619b4b4d0'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.293191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a891038b8b8e42599a3b1ac619b4b4d0'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.314194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-541d8a38-803b-480f-b16e-014ccff35288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a891038b8b8e42599a3b1ac619b4b4d0'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.325349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca78acee8ad941989513d7d027fd6199', 'request_id': 'req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.334614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 925/1826] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:05 2022] DELETE /identity/v3/users/a891038b8b8e42599a3b1ac619b4b4d0 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:06.339925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12ec41-4ef6-4a81-803c-71a29a725e08 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:06.340389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12ec41-4ef6-4a81-803c-71a29a725e08 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:06.340679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12ec41-4ef6-4a81-803c-71a29a725e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:06.361663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ec12ec41-4ef6-4a81-803c-71a29a725e08 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:06.366527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ec12ec41-4ef6-4a81-803c-71a29a725e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:06.418824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca78acee8ad941989513d7d027fd6199', 'request_id': 'req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.426534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca78acee8ad941989513d7d027fd6199', 'request_id': 'req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.441047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 926/1827] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:06.454517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] The token cache is being invalidate because project ca78acee8ad941989513d7d027fd6199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:06.455131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.457046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12ec41-4ef6-4a81-803c-71a29a725e08 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:06.458700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ec12ec41-4ef6-4a81-803c-71a29a725e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:06.461255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.464395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 902/1828] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:06 2022] DELETE /identity/v3/projects/ca78acee8ad941989513d7d027fd6199 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:06.472051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:06.476010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:06.547996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:06.614362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12ec41-4ef6-4a81-803c-71a29a725e08 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:06.624690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:06.627813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:06.629142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:06.629751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:06.634847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:06.669490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:06.671706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:06.682611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b960050-a1b6-4d97-bc9c-2edd0abdbc18 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:06.695676 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 927/1829] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:06.699291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:06.699959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:06.700244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:06.700521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] PATH_INFO: `/v3/users/7a29d3546f6349098013f6726cbd4378` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:06.701785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a29d3546f6349098013f6726cbd4378)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:06.703743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:06.954547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a29d3546f6349098013f6726cbd4378'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.964847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a29d3546f6349098013f6726cbd4378'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.965643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a29d3546f6349098013f6726cbd4378'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.966389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a29d3546f6349098013f6726cbd4378'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.989471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a29d3546f6349098013f6726cbd4378'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:06.990930 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:06.992687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:07.011961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd89edd-be90-4edb-9123-5f1c47ecac17 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:07.030681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:07.037776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:07.040559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:07.040559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:07.040559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] PATH_INFO: `/v3/projects/1d47d1d4976f419b8e1b83d7db54a51e` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:07.040559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d47d1d4976f419b8e1b83d7db54a51e)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:07.051391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:07.150223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 903/1830] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:06 2022] DELETE /identity/v3/users/7a29d3546f6349098013f6726cbd4378 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:07.273123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d47d1d4976f419b8e1b83d7db54a51e', 'request_id': 'req-24cc6dc7-b69f-4306-80df-8a1de143141d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.280089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d47d1d4976f419b8e1b83d7db54a51e', 'request_id': 'req-24cc6dc7-b69f-4306-80df-8a1de143141d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.365323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d47d1d4976f419b8e1b83d7db54a51e', 'request_id': 'req-24cc6dc7-b69f-4306-80df-8a1de143141d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.383315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] The token cache is being invalidate because project 1d47d1d4976f419b8e1b83d7db54a51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:07.383876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.386155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.391743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 928/1831] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:06 2022] DELETE /identity/v3/projects/1d47d1d4976f419b8e1b83d7db54a51e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:07.395876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:07.401037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:07.524485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1243714-9024-460e-a0a7-2beb43093684 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:07.604271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:07.604919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:07.605199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:07.605470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] PATH_INFO: `/v3/users/7595fce798d2459c85429de6b71f2cd3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:07.606631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7595fce798d2459c85429de6b71f2cd3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:07.608568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:07.860216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7595fce798d2459c85429de6b71f2cd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.867817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7595fce798d2459c85429de6b71f2cd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.869132 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7595fce798d2459c85429de6b71f2cd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.869926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7595fce798d2459c85429de6b71f2cd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.885278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7595fce798d2459c85429de6b71f2cd3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:07.954993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:07.957083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:07.961417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:07.973124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 904/1832] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:07 2022] DELETE /identity/v3/users/7595fce798d2459c85429de6b71f2cd3 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:07.989654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc6dc7-b69f-4306-80df-8a1de143141d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:08.072573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:08.073224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:08.073508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:08.073827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] PATH_INFO: `/v3/projects/b7c64aa5a58a4e069f309a6507021699` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:08.077909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c64aa5a58a4e069f309a6507021699)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:08.077909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:08.078912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:08.080383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:08.097716 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ef83-7252-41fd-beec-1cb7baa7a426 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:08.114916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:08.116183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:08.116472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:08.116766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] PATH_INFO: `/v3/projects/b8d35710caa444b582f31b61a18e0296` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:08.119666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d35710caa444b582f31b61a18e0296)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:08.121588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:08.236190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c64aa5a58a4e069f309a6507021699', 'request_id': 'req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.252541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c64aa5a58a4e069f309a6507021699', 'request_id': 'req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.270910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d35710caa444b582f31b61a18e0296', 'request_id': 'req-47df49e2-0e64-4ab5-9831-cf67f371187b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.365316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c64aa5a58a4e069f309a6507021699', 'request_id': 'req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.378764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] The token cache is being invalidate because project b7c64aa5a58a4e069f309a6507021699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:08.379283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.380293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-41ec2dfc-529f-4bd8-b626-74aefadf5c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.382564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 929/1833] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:07 2022] DELETE /identity/v3/projects/b7c64aa5a58a4e069f309a6507021699 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:08.387642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096417-1291-44f1-8614-fefd9f9214e4 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:08.388178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096417-1291-44f1-8614-fefd9f9214e4 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:08.388606 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd096417-1291-44f1-8614-fefd9f9214e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:08.419313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-cd096417-1291-44f1-8614-fefd9f9214e4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:08.422394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cd096417-1291-44f1-8614-fefd9f9214e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:08.485275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d35710caa444b582f31b61a18e0296', 'request_id': 'req-47df49e2-0e64-4ab5-9831-cf67f371187b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.494578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d35710caa444b582f31b61a18e0296', 'request_id': 'req-47df49e2-0e64-4ab5-9831-cf67f371187b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.525278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] The token cache is being invalidate because project b8d35710caa444b582f31b61a18e0296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:08.525594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.527310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.544841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 905/1834] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:08 2022] DELETE /identity/v3/projects/b8d35710caa444b582f31b61a18e0296 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:08.549741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:08.552633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:08.586850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 930/1835] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:08.595581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70ee0-0b19-4c02-b25b-ff4809fc2833 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:08.597968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70ee0-0b19-4c02-b25b-ff4809fc2833 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:08.598420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70ee0-0b19-4c02-b25b-ff4809fc2833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:08.608465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:08.646315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f4e70ee0-0b19-4c02-b25b-ff4809fc2833 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:08.647726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f4e70ee0-0b19-4c02-b25b-ff4809fc2833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:08.659804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 931/1836] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:08.660978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70ee0-0b19-4c02-b25b-ff4809fc2833 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:08.670710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70ee0-0b19-4c02-b25b-ff4809fc2833 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:08.676323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:08.677152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:08.677538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:08.683720 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:08.684046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df49e2-0e64-4ab5-9831-cf67f371187b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:08.684139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:08.684139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:08.684139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:08.684410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:08.684410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:08.684410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:08.684665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] PATH_INFO: `/v3/users/d53082470c454aea9196e67c66801cc2` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:08.685644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53082470c454aea9196e67c66801cc2)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:08.688495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:08.701203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 932/1837] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:08.705768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:08.716364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77993232-d53e-4984-a9e5-fb6d3b360383 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:08.723231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:08.723630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:08.723910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:08.724185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:08.724846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:08.727742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:08.852736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 933/1838] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:08 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:08.852736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:08.854520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:08.885807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53082470c454aea9196e67c66801cc2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.894805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53082470c454aea9196e67c66801cc2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.895533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53082470c454aea9196e67c66801cc2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.896155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53082470c454aea9196e67c66801cc2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.911254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53082470c454aea9196e67c66801cc2'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:08.929671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73013e3-e180-4ee9-bf27-abb4fe05c8ba admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:08.934449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:08.935404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:08.935590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:08.936185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] PATH_INFO: `/v3/projects/4dd0179b0429492fb947dfd0a85f82a5` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:08.937305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd0179b0429492fb947dfd0a85f82a5)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:08.939263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.070675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 906/1839] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:08 2022] DELETE /identity/v3/users/d53082470c454aea9196e67c66801cc2 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:09.074316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.075841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:09.087338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd0179b0429492fb947dfd0a85f82a5', 'request_id': 'req-26e433cb-5e84-4a97-998d-8b190df29f74'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:09.095509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd0179b0429492fb947dfd0a85f82a5', 'request_id': 'req-26e433cb-5e84-4a97-998d-8b190df29f74'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:09.154916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b85b-2191-41e0-875d-663dfcf4f4e8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:09.161427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2e80b-3191-404a-99cc-80f62723162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:09.162870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e80b-3191-404a-99cc-80f62723162a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.163343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e80b-3191-404a-99cc-80f62723162a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.164236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2e80b-3191-404a-99cc-80f62723162a admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.164883 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2e80b-3191-404a-99cc-80f62723162a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:09.167501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2e80b-3191-404a-99cc-80f62723162a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.173290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd0179b0429492fb947dfd0a85f82a5', 'request_id': 'req-26e433cb-5e84-4a97-998d-8b190df29f74'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:09.186714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] The token cache is being invalidate because project 4dd0179b0429492fb947dfd0a85f82a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:09.187009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:09.187719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-26e433cb-5e84-4a97-998d-8b190df29f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:09.189454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 934/1840] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:08 2022] DELETE /identity/v3/projects/4dd0179b0429492fb947dfd0a85f82a5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:09.194898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a835-6321-4c71-9152-12c022291894 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.195187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a835-6321-4c71-9152-12c022291894 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.195465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291a835-6321-4c71-9152-12c022291894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.214797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e291a835-6321-4c71-9152-12c022291894 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:09.216016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e291a835-6321-4c71-9152-12c022291894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:09.224796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 935/1841] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:09.226172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05105156-7129-4669-aef3-6f3043569b6d None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.226465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05105156-7129-4669-aef3-6f3043569b6d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.226745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05105156-7129-4669-aef3-6f3043569b6d None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.228044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 936/1842] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:35:09.232572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b04872-273c-41a2-8bb8-5eaa291a0d66 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.232868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b04872-273c-41a2-8bb8-5eaa291a0d66 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.233143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b04872-273c-41a2-8bb8-5eaa291a0d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.253026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e2b04872-273c-41a2-8bb8-5eaa291a0d66 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:09.254276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e2b04872-273c-41a2-8bb8-5eaa291a0d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:09.262519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 937/1843] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:09.265698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96dba-f0fa-47f6-8e01-bcf6f76b0632 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.265698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96dba-f0fa-47f6-8e01-bcf6f76b0632 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.265698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf96dba-f0fa-47f6-8e01-bcf6f76b0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.289758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-fbf96dba-f0fa-47f6-8e01-bcf6f76b0632 None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:09.292870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fbf96dba-f0fa-47f6-8e01-bcf6f76b0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:09.296677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 907/1844] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:09 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:09.299347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2e80b-3191-404a-99cc-80f62723162a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.313960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2e80b-3191-404a-99cc-80f62723162a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:09.338528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:09.340489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.341578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.342755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.345093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:09.346361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:09.350918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.375955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 908/1845] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:09.381697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.381697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:09.401406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e432bb-0853-4fe7-9b3d-240ceb13cfbe admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:09.406769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 938/1846] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:09.408264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96dba-f0fa-47f6-8e01-bcf6f76b0632 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.412768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5880d3-9287-4b42-aa07-710bf48fea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:09.414458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5880d3-9287-4b42-aa07-710bf48fea3b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.414793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5880d3-9287-4b42-aa07-710bf48fea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.415071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5880d3-9287-4b42-aa07-710bf48fea3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.415733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5880d3-9287-4b42-aa07-710bf48fea3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:09.418595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5880d3-9287-4b42-aa07-710bf48fea3b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.428330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf96dba-f0fa-47f6-8e01-bcf6f76b0632 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:09.434138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28568fef-2476-4e65-87b1-eb58d3b61857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:09.435582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 909/1847] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:09.435705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28568fef-2476-4e65-87b1-eb58d3b61857 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.436239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28568fef-2476-4e65-87b1-eb58d3b61857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.436576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28568fef-2476-4e65-87b1-eb58d3b61857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.437340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28568fef-2476-4e65-87b1-eb58d3b61857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:09.439355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5880d3-9287-4b42-aa07-710bf48fea3b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.443181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28568fef-2476-4e65-87b1-eb58d3b61857 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.459726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5880d3-9287-4b42-aa07-710bf48fea3b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:09.467326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542d73-9bf8-422b-a926-a6fcde7ddb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:09.468264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542d73-9bf8-422b-a926-a6fcde7ddb2f admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.468555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542d73-9bf8-422b-a926-a6fcde7ddb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.468895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf542d73-9bf8-422b-a926-a6fcde7ddb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.472192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf542d73-9bf8-422b-a926-a6fcde7ddb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:09.478513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf542d73-9bf8-422b-a926-a6fcde7ddb2f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.490781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 910/1848] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:09.495690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542d73-9bf8-422b-a926-a6fcde7ddb2f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.518318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf542d73-9bf8-422b-a926-a6fcde7ddb2f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:09.538135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:09.539079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.539520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.542037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] PATH_INFO: `/v3/projects/0f53411098674788915e12e1058b39a0/users/47432485789243e1b40043fab85ee123/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.543866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 939/1849] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:09 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:09.549802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28568fef-2476-4e65-87b1-eb58d3b61857 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.573871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f53411098674788915e12e1058b39a0, user_id=47432485789243e1b40043fab85ee123, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:09.581842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.651194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28568fef-2476-4e65-87b1-eb58d3b61857 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:09.661582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d3f7a-0498-498c-bcda-693ab23598f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:09.662361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3f7a-0498-498c-bcda-693ab23598f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.663049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3f7a-0498-498c-bcda-693ab23598f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.663399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3f7a-0498-498c-bcda-693ab23598f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.664056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d3f7a-0498-498c-bcda-693ab23598f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:09.666186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d3f7a-0498-498c-bcda-693ab23598f8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.714269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 911/1850] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:09 2022] PUT /identity/v3/projects/0f53411098674788915e12e1058b39a0/users/47432485789243e1b40043fab85ee123/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:09.716131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.721768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:09.839287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 940/1851] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:09 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:09.841666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63078a3e-bba9-40d4-b22a-73746ae5a01d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.842298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63078a3e-bba9-40d4-b22a-73746ae5a01d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.842584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63078a3e-bba9-40d4-b22a-73746ae5a01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.853874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e5af7-095c-44e6-8607-b0d73e60fd6c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:09.859826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:09.860556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:09.860912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:09.861263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] PATH_INFO: `/v3/projects/6b2b687813604b2d990e7b6f12afaf46` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:09.863466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2b687813604b2d990e7b6f12afaf46)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:09.882326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:09.894693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-63078a3e-bba9-40d4-b22a-73746ae5a01d None None] MFA Rules not processed for user `47432485789243e1b40043fab85ee123`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:09.896237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-63078a3e-bba9-40d4-b22a-73746ae5a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:09.981357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 941/1852] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:09.982329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63078a3e-bba9-40d4-b22a-73746ae5a01d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:09.983686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-63078a3e-bba9-40d4-b22a-73746ae5a01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:10.082796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63078a3e-bba9-40d4-b22a-73746ae5a01d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.087815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2b687813604b2d990e7b6f12afaf46', 'request_id': 'req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:10.149627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204af4e-8e8e-4e6b-be7a-d4b8886d79fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.150276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204af4e-8e8e-4e6b-be7a-d4b8886d79fc service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.150565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204af4e-8e8e-4e6b-be7a-d4b8886d79fc service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.150844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204af4e-8e8e-4e6b-be7a-d4b8886d79fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.168596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204af4e-8e8e-4e6b-be7a-d4b8886d79fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.170422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204af4e-8e8e-4e6b-be7a-d4b8886d79fc service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.178851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2b687813604b2d990e7b6f12afaf46', 'request_id': 'req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:10.185867 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 942/1853] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:10.187396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204af4e-8e8e-4e6b-be7a-d4b8886d79fc service nova] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.190471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2b687813604b2d990e7b6f12afaf46', 'request_id': 'req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:10.207745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] The token cache is being invalidate because project 6b2b687813604b2d990e7b6f12afaf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:10.208707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:10.210621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:10.212417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 912/1854] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:09 2022] DELETE /identity/v3/projects/6b2b687813604b2d990e7b6f12afaf46 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:10.213352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.215935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:10.271471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204af4e-8e8e-4e6b-be7a-d4b8886d79fc service nova] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.278310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f3c9-b0cc-42b0-aa60-f949359d0b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.279040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f3c9-b0cc-42b0-aa60-f949359d0b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.279332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f3c9-b0cc-42b0-aa60-f949359d0b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.279612 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f3c9-b0cc-42b0-aa60-f949359d0b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.280268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97f3c9-b0cc-42b0-aa60-f949359d0b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.281942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97f3c9-b0cc-42b0-aa60-f949359d0b28 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.288130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd64553-e96d-4e9c-9b4d-71cf6e82eec6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.297405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 943/1855] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:10.297405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684dda-83c4-4869-b98e-11db6fb534c5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.297666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb986d-bc6c-4d9f-9f04-1a64e821eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.298121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684dda-83c4-4869-b98e-11db6fb534c5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.298121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b684dda-83c4-4869-b98e-11db6fb534c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.298302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb986d-bc6c-4d9f-9f04-1a64e821eeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.298302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb986d-bc6c-4d9f-9f04-1a64e821eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.298302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb986d-bc6c-4d9f-9f04-1a64e821eeb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.298302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb986d-bc6c-4d9f-9f04-1a64e821eeb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.300397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb986d-bc6c-4d9f-9f04-1a64e821eeb1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.316919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4b684dda-83c4-4869-b98e-11db6fb534c5 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:10.318194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4b684dda-83c4-4869-b98e-11db6fb534c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:10.329767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 944/1856] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:10.330706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b684dda-83c4-4869-b98e-11db6fb534c5 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.334988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4b684dda-83c4-4869-b98e-11db6fb534c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:10.346941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b684dda-83c4-4869-b98e-11db6fb534c5 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.351559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f196d-a0a6-43ca-9902-36cf5c46f891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.352205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f196d-a0a6-43ca-9902-36cf5c46f891 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.352498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f196d-a0a6-43ca-9902-36cf5c46f891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.352767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f196d-a0a6-43ca-9902-36cf5c46f891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.353410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f196d-a0a6-43ca-9902-36cf5c46f891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.355048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f196d-a0a6-43ca-9902-36cf5c46f891 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.365455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 945/1857] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:10.366639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2b5a-b760-494e-96ee-35ca6422605e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.366999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2b5a-b760-494e-96ee-35ca6422605e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.367279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2b5a-b760-494e-96ee-35ca6422605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.386167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e69d2b5a-b760-494e-96ee-35ca6422605e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:10.387626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e69d2b5a-b760-494e-96ee-35ca6422605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:10.395545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 946/1858] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:10.396279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d2b5a-b760-494e-96ee-35ca6422605e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.406221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d2b5a-b760-494e-96ee-35ca6422605e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.408393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 913/1859] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:10 2022] POST /identity/v3/projects => generated 401 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:10.408742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb986d-bc6c-4d9f-9f04-1a64e821eeb1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.428950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:10.471734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f59e7-d6c2-483a-a379-6a9dd1a52ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.472622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f59e7-d6c2-483a-a379-6a9dd1a52ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.472913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f59e7-d6c2-483a-a379-6a9dd1a52ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.473193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f59e7-d6c2-483a-a379-6a9dd1a52ea7 admin admin] PATH_INFO: `/v3/projects/dae48bb6e161401a87fcf5d4ae5127a7/users/aea7fe81f1174e1b9157e14327ba6856/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.489601 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f59e7-d6c2-483a-a379-6a9dd1a52ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae48bb6e161401a87fcf5d4ae5127a7, user_id=aea7fe81f1174e1b9157e14327ba6856, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.492837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f59e7-d6c2-483a-a379-6a9dd1a52ea7 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.495765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb986d-bc6c-4d9f-9f04-1a64e821eeb1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.500472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.501140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.501414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.501746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.503008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:10.503311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.504889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.522504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 914/1860] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:10.522504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.532123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b7a0-a7a9-4bba-8965-73037cfc96b5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.536800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823910e-1364-4d57-b60b-0e92fa5dfcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.537445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823910e-1364-4d57-b60b-0e92fa5dfcac admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.537778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823910e-1364-4d57-b60b-0e92fa5dfcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.538153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823910e-1364-4d57-b60b-0e92fa5dfcac admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.538676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823910e-1364-4d57-b60b-0e92fa5dfcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.540612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823910e-1364-4d57-b60b-0e92fa5dfcac admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.568218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:10.575233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 947/1861] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:10 2022] PUT /identity/v3/projects/dae48bb6e161401a87fcf5d4ae5127a7/users/aea7fe81f1174e1b9157e14327ba6856/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:10.575233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f59e7-d6c2-483a-a379-6a9dd1a52ea7 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.636377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 915/1862] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:10 2022] POST /identity/v3/users => generated 307 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:10.638198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63262-95be-404e-99d7-f25994ddf85e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.638493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63262-95be-404e-99d7-f25994ddf85e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.638941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63262-95be-404e-99d7-f25994ddf85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.644715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f59e7-d6c2-483a-a379-6a9dd1a52ea7 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.652981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140bc66-7556-4ef6-99fa-12d35f2e74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.654143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140bc66-7556-4ef6-99fa-12d35f2e74c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.657409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140bc66-7556-4ef6-99fa-12d35f2e74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.657409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140bc66-7556-4ef6-99fa-12d35f2e74c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.657409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140bc66-7556-4ef6-99fa-12d35f2e74c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.658300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140bc66-7556-4ef6-99fa-12d35f2e74c5 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.674984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-10d63262-95be-404e-99d7-f25994ddf85e None None] MFA Rules not processed for user `aea7fe81f1174e1b9157e14327ba6856`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:10.676327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-10d63262-95be-404e-99d7-f25994ddf85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:10.760264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 916/1863] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:10.760264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d63262-95be-404e-99d7-f25994ddf85e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.762631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 948/1864] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:10 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:10.763898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140bc66-7556-4ef6-99fa-12d35f2e74c5 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.774780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d63262-95be-404e-99d7-f25994ddf85e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.855789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720908-bd97-434b-b042-3ba818b69b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.856503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720908-bd97-434b-b042-3ba818b69b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.857000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720908-bd97-434b-b042-3ba818b69b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.857368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720908-bd97-434b-b042-3ba818b69b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.857982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140bc66-7556-4ef6-99fa-12d35f2e74c5 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.858209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f720908-bd97-434b-b042-3ba818b69b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.860121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f720908-bd97-434b-b042-3ba818b69b2c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.863555 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e5437-82c4-43eb-9687-b03c1b346638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.864440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5437-82c4-43eb-9687-b03c1b346638 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.864738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5437-82c4-43eb-9687-b03c1b346638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.865277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5437-82c4-43eb-9687-b03c1b346638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.865986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e5437-82c4-43eb-9687-b03c1b346638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.869382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e5437-82c4-43eb-9687-b03c1b346638 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.874381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 917/1865] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:10.874381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720908-bd97-434b-b042-3ba818b69b2c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.887778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720908-bd97-434b-b042-3ba818b69b2c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:10.902994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a65b9-7d73-48e0-b28c-fdf495be88b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:10.906694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a65b9-7d73-48e0-b28c-fdf495be88b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:10.906694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a65b9-7d73-48e0-b28c-fdf495be88b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:10.906694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a65b9-7d73-48e0-b28c-fdf495be88b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:10.906694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a65b9-7d73-48e0-b28c-fdf495be88b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:10.907328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a65b9-7d73-48e0-b28c-fdf495be88b2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:10.993944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 918/1866] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:10 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:10.995183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a65b9-7d73-48e0-b28c-fdf495be88b2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:10.997885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 949/1867] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:10 2022] POST /identity/v3/projects => generated 387 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:11.002906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e5437-82c4-43eb-9687-b03c1b346638 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.008697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a65b9-7d73-48e0-b28c-fdf495be88b2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.088525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e5437-82c4-43eb-9687-b03c1b346638 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.094253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90180f-b6cd-4a83-bfc6-76efa3a88e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.094944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90180f-b6cd-4a83-bfc6-76efa3a88e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.095279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90180f-b6cd-4a83-bfc6-76efa3a88e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.098714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90180f-b6cd-4a83-bfc6-76efa3a88e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.098714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90180f-b6cd-4a83-bfc6-76efa3a88e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.098714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90180f-b6cd-4a83-bfc6-76efa3a88e66 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.111028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 950/1868] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:11.112474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90180f-b6cd-4a83-bfc6-76efa3a88e66 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.118820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b297131-ae5f-41ee-935e-7cc9b2901bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.119879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b297131-ae5f-41ee-935e-7cc9b2901bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.120653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b297131-ae5f-41ee-935e-7cc9b2901bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.120945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b297131-ae5f-41ee-935e-7cc9b2901bf1 admin admin] PATH_INFO: `/v3/projects/c2f70afd62be4c81814cbd5ab6631dd8/users/c081e0011d2d4ad5be4e10840d88e9be/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.124514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90180f-b6cd-4a83-bfc6-76efa3a88e66 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.134822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1277986-c8ca-46b7-89b3-db1a736683b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.135637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277986-c8ca-46b7-89b3-db1a736683b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.136028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277986-c8ca-46b7-89b3-db1a736683b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.136322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1277986-c8ca-46b7-89b3-db1a736683b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.138718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1277986-c8ca-46b7-89b3-db1a736683b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.140804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1277986-c8ca-46b7-89b3-db1a736683b4 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.141463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b297131-ae5f-41ee-935e-7cc9b2901bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f70afd62be4c81814cbd5ab6631dd8, user_id=c081e0011d2d4ad5be4e10840d88e9be, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.146480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b297131-ae5f-41ee-935e-7cc9b2901bf1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.217341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 919/1869] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:10 2022] PUT /identity/v3/projects/c2f70afd62be4c81814cbd5ab6631dd8/users/c081e0011d2d4ad5be4e10840d88e9be/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:11.218314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b297131-ae5f-41ee-935e-7cc9b2901bf1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.248590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 951/1870] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:11 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:11.248590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1277986-c8ca-46b7-89b3-db1a736683b4 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.256209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1277986-c8ca-46b7-89b3-db1a736683b4 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.298032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b297131-ae5f-41ee-935e-7cc9b2901bf1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.303773 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1d9d-2346-4dc2-86bb-63b65078335e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.304392 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1d9d-2346-4dc2-86bb-63b65078335e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.304671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1d9d-2346-4dc2-86bb-63b65078335e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.304939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1d9d-2346-4dc2-86bb-63b65078335e admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.305590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f1d9d-2346-4dc2-86bb-63b65078335e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.307696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f1d9d-2346-4dc2-86bb-63b65078335e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.318214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 920/1871] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:11.318965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1d9d-2346-4dc2-86bb-63b65078335e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.330854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1d9d-2346-4dc2-86bb-63b65078335e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.333388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5e7b4-7032-4137-8fc9-aac101388683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.334171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e7b4-7032-4137-8fc9-aac101388683 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.335033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e7b4-7032-4137-8fc9-aac101388683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.335033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e7b4-7032-4137-8fc9-aac101388683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.335776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5e7b4-7032-4137-8fc9-aac101388683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.337568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd762-a278-4f45-86cd-ec2924aca4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.337725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5e7b4-7032-4137-8fc9-aac101388683 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.338205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd762-a278-4f45-86cd-ec2924aca4db admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.339018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd762-a278-4f45-86cd-ec2924aca4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.339018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabd762-a278-4f45-86cd-ec2924aca4db admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.339525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabd762-a278-4f45-86cd-ec2924aca4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.341213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabd762-a278-4f45-86cd-ec2924aca4db admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.350004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 952/1872] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:11.350812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5e7b4-7032-4137-8fc9-aac101388683 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.357341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 921/1873] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:11.358196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd762-a278-4f45-86cd-ec2924aca4db admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.362330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5e7b4-7032-4137-8fc9-aac101388683 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.367883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9685a-18d0-4be6-a554-34a323c78d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.368673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9685a-18d0-4be6-a554-34a323c78d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.369124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabd762-a278-4f45-86cd-ec2924aca4db admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.369259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9685a-18d0-4be6-a554-34a323c78d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.369517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9685a-18d0-4be6-a554-34a323c78d7c admin admin] PATH_INFO: `/v3/projects/eb6d8ec2c986451e8808c803193731b4/users/afb3affc4dff4783903882501ca95c15/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.378289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fabfcb-60fa-4e9f-bb4b-c6525c9e8569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.379280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabfcb-60fa-4e9f-bb4b-c6525c9e8569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.380019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabfcb-60fa-4e9f-bb4b-c6525c9e8569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.380202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fabfcb-60fa-4e9f-bb4b-c6525c9e8569 admin admin] PATH_INFO: `/v3/projects/c2f70afd62be4c81814cbd5ab6631dd8/users/c081e0011d2d4ad5be4e10840d88e9be/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.382417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fabfcb-60fa-4e9f-bb4b-c6525c9e8569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f70afd62be4c81814cbd5ab6631dd8, user_id=c081e0011d2d4ad5be4e10840d88e9be, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.397797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fabfcb-60fa-4e9f-bb4b-c6525c9e8569 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.397950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9685a-18d0-4be6-a554-34a323c78d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6d8ec2c986451e8808c803193731b4, user_id=afb3affc4dff4783903882501ca95c15, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.397950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9685a-18d0-4be6-a554-34a323c78d7c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.400020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 922/1874] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:11 2022] PUT /identity/v3/projects/c2f70afd62be4c81814cbd5ab6631dd8/users/c081e0011d2d4ad5be4e10840d88e9be/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:11.408894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fabfcb-60fa-4e9f-bb4b-c6525c9e8569 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.466549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fabfcb-60fa-4e9f-bb4b-c6525c9e8569 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.471211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e5872-1031-4358-b7bb-157dcf9759c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.471868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5872-1031-4358-b7bb-157dcf9759c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.472149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5872-1031-4358-b7bb-157dcf9759c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.472424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e5872-1031-4358-b7bb-157dcf9759c1 admin admin] PATH_INFO: `/v3/projects/88fdcfe2ac3d4e6bb6676247a5585dde/users/853018fe45194f6d96b4c635b966ff2b/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.486449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e5872-1031-4358-b7bb-157dcf9759c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fdcfe2ac3d4e6bb6676247a5585dde, user_id=853018fe45194f6d96b4c635b966ff2b, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.489228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e5872-1031-4358-b7bb-157dcf9759c1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.503336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 953/1875] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:11 2022] PUT /identity/v3/projects/eb6d8ec2c986451e8808c803193731b4/users/afb3affc4dff4783903882501ca95c15/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:11.504598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04361b6-158e-4de2-a9d2-f4aa3477926c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.505562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04361b6-158e-4de2-a9d2-f4aa3477926c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.505562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04361b6-158e-4de2-a9d2-f4aa3477926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.532828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e04361b6-158e-4de2-a9d2-f4aa3477926c None None] MFA Rules not processed for user `c081e0011d2d4ad5be4e10840d88e9be`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:11.534172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e04361b6-158e-4de2-a9d2-f4aa3477926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:11.594295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 923/1876] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:11 2022] PUT /identity/v3/projects/88fdcfe2ac3d4e6bb6676247a5585dde/users/853018fe45194f6d96b4c635b966ff2b/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:11.600161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718aa8e-6055-45ef-81cc-6c104582c871 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.600454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718aa8e-6055-45ef-81cc-6c104582c871 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.600733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718aa8e-6055-45ef-81cc-6c104582c871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.601881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 954/1877] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:11.606082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04361b6-158e-4de2-a9d2-f4aa3477926c None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.633023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8718aa8e-6055-45ef-81cc-6c104582c871 None None] MFA Rules not processed for user `afb3affc4dff4783903882501ca95c15`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:11.634271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8718aa8e-6055-45ef-81cc-6c104582c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:11.685173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04361b6-158e-4de2-a9d2-f4aa3477926c None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.708260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 924/1878] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:11.709642 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718aa8e-6055-45ef-81cc-6c104582c871 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.711252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8718aa8e-6055-45ef-81cc-6c104582c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:11.749062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a52a3-cfa5-41dd-89f3-dfa4c701b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.749709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a52a3-cfa5-41dd-89f3-dfa4c701b42a admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.749996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a52a3-cfa5-41dd-89f3-dfa4c701b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.750270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a52a3-cfa5-41dd-89f3-dfa4c701b42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.750924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a52a3-cfa5-41dd-89f3-dfa4c701b42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.753697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a52a3-cfa5-41dd-89f3-dfa4c701b42a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.766394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 955/1879] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:11.767262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a52a3-cfa5-41dd-89f3-dfa4c701b42a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.770703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718aa8e-6055-45ef-81cc-6c104582c871 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.774406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9309-5d3e-48bf-bf55-b7a673948623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.775280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9309-5d3e-48bf-bf55-b7a673948623 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.775575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9309-5d3e-48bf-bf55-b7a673948623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.775866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9309-5d3e-48bf-bf55-b7a673948623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.782029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a52a3-cfa5-41dd-89f3-dfa4c701b42a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.783566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9929a-232f-441f-ad3c-27433871ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.784206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9929a-232f-441f-ad3c-27433871ad05 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.784488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9929a-232f-441f-ad3c-27433871ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.784766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9929a-232f-441f-ad3c-27433871ad05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.785393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9929a-232f-441f-ad3c-27433871ad05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.787346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9929a-232f-441f-ad3c-27433871ad05 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.835861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9309-5d3e-48bf-bf55-b7a673948623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.837350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9309-5d3e-48bf-bf55-b7a673948623 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.846903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 925/1880] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:11.847619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9309-5d3e-48bf-bf55-b7a673948623 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.858869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9309-5d3e-48bf-bf55-b7a673948623 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.864120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0d201-c86d-416d-a17a-e445d5beb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.864900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0d201-c86d-416d-a17a-e445d5beb949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.865175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0d201-c86d-416d-a17a-e445d5beb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.865452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0d201-c86d-416d-a17a-e445d5beb949 admin admin] PATH_INFO: `/v3/projects/88fdcfe2ac3d4e6bb6676247a5585dde/users/853018fe45194f6d96b4c635b966ff2b/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.867503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0d201-c86d-416d-a17a-e445d5beb949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88fdcfe2ac3d4e6bb6676247a5585dde, user_id=853018fe45194f6d96b4c635b966ff2b, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.870269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0d201-c86d-416d-a17a-e445d5beb949 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.878099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 956/1881] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:11 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:11.881652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 926/1882] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:11 2022] PUT /identity/v3/projects/88fdcfe2ac3d4e6bb6676247a5585dde/users/853018fe45194f6d96b4c635b966ff2b/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:11.882120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9929a-232f-441f-ad3c-27433871ad05 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:11.893166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863be49e-def7-45f9-8256-30233cbc73b8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.893447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863be49e-def7-45f9-8256-30233cbc73b8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.893766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863be49e-def7-45f9-8256-30233cbc73b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.920008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-863be49e-def7-45f9-8256-30233cbc73b8 None None] MFA Rules not processed for user `853018fe45194f6d96b4c635b966ff2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:11.921183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-863be49e-def7-45f9-8256-30233cbc73b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:11.944129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9929a-232f-441f-ad3c-27433871ad05 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:11.949287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fd8a2-d126-43e9-8981-e935cdfa10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:11.949937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd8a2-d126-43e9-8981-e935cdfa10e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:11.950224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd8a2-d126-43e9-8981-e935cdfa10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:11.950503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd8a2-d126-43e9-8981-e935cdfa10e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:11.951133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fd8a2-d126-43e9-8981-e935cdfa10e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:11.953120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fd8a2-d126-43e9-8981-e935cdfa10e9 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:11.989525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 927/1883] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:12.003955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863be49e-def7-45f9-8256-30233cbc73b8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.005197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-863be49e-def7-45f9-8256-30233cbc73b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:12.063581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863be49e-def7-45f9-8256-30233cbc73b8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:12.067306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54456a9c-cdf6-4348-aab7-279bb3b2ed65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:12.067918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54456a9c-cdf6-4348-aab7-279bb3b2ed65 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.068200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54456a9c-cdf6-4348-aab7-279bb3b2ed65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.068472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54456a9c-cdf6-4348-aab7-279bb3b2ed65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.077544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54456a9c-cdf6-4348-aab7-279bb3b2ed65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:12.079028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54456a9c-cdf6-4348-aab7-279bb3b2ed65 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:12.088912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 928/1884] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:12.123569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 957/1885] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:11 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:12.139091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54456a9c-cdf6-4348-aab7-279bb3b2ed65 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.150281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54456a9c-cdf6-4348-aab7-279bb3b2ed65 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:12.156920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660dd50-7c3d-464a-b365-c48359585f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:12.157519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660dd50-7c3d-464a-b365-c48359585f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.157834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660dd50-7c3d-464a-b365-c48359585f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.158104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660dd50-7c3d-464a-b365-c48359585f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.158738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660dd50-7c3d-464a-b365-c48359585f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:12.160314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660dd50-7c3d-464a-b365-c48359585f3c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:12.191553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 929/1886] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:12.195794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fd8a2-d126-43e9-8981-e935cdfa10e9 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.199172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660dd50-7c3d-464a-b365-c48359585f3c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.206440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fd8a2-d126-43e9-8981-e935cdfa10e9 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:12.211369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660dd50-7c3d-464a-b365-c48359585f3c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:12.212367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660cceb-6062-4da7-a14e-6a041b38a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:12.213214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660cceb-6062-4da7-a14e-6a041b38a94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.213668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660cceb-6062-4da7-a14e-6a041b38a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.214140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660cceb-6062-4da7-a14e-6a041b38a94a admin admin] PATH_INFO: `/v3/projects/e7a50811838e4563b87c071ac9d3c9ef/users/414d4b43de9a4115b918c5226eaed637/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.217908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:12.219360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.219360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.219360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] PATH_INFO: `/v3/users/aea7fe81f1174e1b9157e14327ba6856` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.220484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea7fe81f1174e1b9157e14327ba6856)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:12.222962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:12.237365 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660cceb-6062-4da7-a14e-6a041b38a94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a50811838e4563b87c071ac9d3c9ef, user_id=414d4b43de9a4115b918c5226eaed637, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:12.241594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660cceb-6062-4da7-a14e-6a041b38a94a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:12.262707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:12.353251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 958/1887] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:12 2022] PUT /identity/v3/projects/e7a50811838e4563b87c071ac9d3c9ef/users/414d4b43de9a4115b918c5226eaed637/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:12.353251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660cceb-6062-4da7-a14e-6a041b38a94a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.407604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660cceb-6062-4da7-a14e-6a041b38a94a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:12.412192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:12.412920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.413207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.413506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.415408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:12.468531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea7fe81f1174e1b9157e14327ba6856'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:12.478303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea7fe81f1174e1b9157e14327ba6856'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:12.478793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea7fe81f1174e1b9157e14327ba6856'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:12.479589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea7fe81f1174e1b9157e14327ba6856'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:12.497650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6869947e-a8e0-42ee-a97e-3f8a364a67a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea7fe81f1174e1b9157e14327ba6856'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:12.510854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:12.512874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:12.523851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 959/1888] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:12.524913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.584108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 930/1889] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:12 2022] DELETE /identity/v3/users/aea7fe81f1174e1b9157e14327ba6856 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:12.586257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68a2f7-5f6b-4ea9-b9f9-d275fa2cf427 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.586641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68a2f7-5f6b-4ea9-b9f9-d275fa2cf427 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.587129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68a2f7-5f6b-4ea9-b9f9-d275fa2cf427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.605997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f46c92-255c-4433-9b02-9527c71a7d21 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:12.614878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2a68a2f7-5f6b-4ea9-b9f9-d275fa2cf427 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:12.616219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2a68a2f7-5f6b-4ea9-b9f9-d275fa2cf427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:12.697082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 931/1890] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:12.708974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68a2f7-5f6b-4ea9-b9f9-d275fa2cf427 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.710198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2a68a2f7-5f6b-4ea9-b9f9-d275fa2cf427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:12.727378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:12.727999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.728282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.728913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.729184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:12.730824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:12.749596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 960/1891] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:12.762673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.766645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:12.792431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57fd9e-8d42-4369-afa2-0bcd3ae15763 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:12.801785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd79e1-64a3-4858-9880-6cbf6bea5c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:12.802593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd79e1-64a3-4858-9880-6cbf6bea5c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.802950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd79e1-64a3-4858-9880-6cbf6bea5c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.803277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd79e1-64a3-4858-9880-6cbf6bea5c08 admin admin] PATH_INFO: `/v3/projects/e7a50811838e4563b87c071ac9d3c9ef/users/414d4b43de9a4115b918c5226eaed637/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.805316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd79e1-64a3-4858-9880-6cbf6bea5c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a50811838e4563b87c071ac9d3c9ef, user_id=414d4b43de9a4115b918c5226eaed637, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:12.808138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd79e1-64a3-4858-9880-6cbf6bea5c08 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:12.808429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68a2f7-5f6b-4ea9-b9f9-d275fa2cf427 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:12.813018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:12.813675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.813961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.814329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.820402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 961/1892] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:12 2022] PUT /identity/v3/projects/e7a50811838e4563b87c071ac9d3c9ef/users/414d4b43de9a4115b918c5226eaed637/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:12.833862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:12.835406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53911-9ec8-4983-88a1-17ba715e5f05 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:12.835705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53911-9ec8-4983-88a1-17ba715e5f05 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:12.836041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e53911-9ec8-4983-88a1-17ba715e5f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:12.836837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:12.852156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 932/1893] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:12.873004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-85e53911-9ec8-4983-88a1-17ba715e5f05 None None] MFA Rules not processed for user `414d4b43de9a4115b918c5226eaed637`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:12.874280 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-85e53911-9ec8-4983-88a1-17ba715e5f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:12.973921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 962/1894] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:12.986355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:12.988381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:13.045798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b00cb0-ce0f-465d-8efe-49a12e1d4038 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:13.095695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:13.097047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:13.097333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:13.097635 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:13.108477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:13.110149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:13.137778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 933/1895] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:13.300752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e53911-9ec8-4983-88a1-17ba715e5f05 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:13.311863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e53911-9ec8-4983-88a1-17ba715e5f05 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:13.316415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:13.318282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:13.318282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:13.318282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:13.320764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:13.359677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:13.369368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:13.371569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:13.422832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:13.425902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:13.450611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 963/1896] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:13.549826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005756-bff5-4a3c-a2d4-6165c3decdea service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:13.559699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:13.560412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:13.560693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:13.560963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] PATH_INFO: `/v3/projects/dae48bb6e161401a87fcf5d4ae5127a7` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:13.562142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae48bb6e161401a87fcf5d4ae5127a7)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:13.564055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:13.704831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae48bb6e161401a87fcf5d4ae5127a7', 'request_id': 'req-6de3f9e5-88f7-46a1-9277-b41dcea3a943'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:13.824740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae48bb6e161401a87fcf5d4ae5127a7', 'request_id': 'req-6de3f9e5-88f7-46a1-9277-b41dcea3a943'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:13.849033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae48bb6e161401a87fcf5d4ae5127a7', 'request_id': 'req-6de3f9e5-88f7-46a1-9277-b41dcea3a943'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:13.855549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] The token cache is being invalidate because project dae48bb6e161401a87fcf5d4ae5127a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:13.856066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:13.858632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:13.861130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 934/1897] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:13 2022] DELETE /identity/v3/projects/dae48bb6e161401a87fcf5d4ae5127a7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:13.866754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:13.890370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8563-8364-4dcc-b629-eed7722cc490 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:13.939170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:13.980875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:13.981592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:13.981982 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:13.982336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] PATH_INFO: `/v3/users/853018fe45194f6d96b4c635b966ff2b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:13.983578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] RBAC: Authorizing `identity:delete_user(user_id=853018fe45194f6d96b4c635b966ff2b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:13.985591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:14.109246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:14.110910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:14.125562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3f9e5-88f7-46a1-9277-b41dcea3a943 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:14.130966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:14.131805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:14.132189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:14.132592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] PATH_INFO: `/v3/users/afb3affc4dff4783903882501ca95c15` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:14.133838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb3affc4dff4783903882501ca95c15)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:14.135819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:14.269880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853018fe45194f6d96b4c635b966ff2b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.270610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853018fe45194f6d96b4c635b966ff2b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.271276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853018fe45194f6d96b4c635b966ff2b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.340955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb3affc4dff4783903882501ca95c15'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.347615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb3affc4dff4783903882501ca95c15'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.348272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb3affc4dff4783903882501ca95c15'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.348920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb3affc4dff4783903882501ca95c15'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.350594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853018fe45194f6d96b4c635b966ff2b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.362264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb3affc4dff4783903882501ca95c15'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.364342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e1020c83-ee5e-4a25-9e20-3d4a0698f57e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853018fe45194f6d96b4c635b966ff2b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.376797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 964/1898] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:13 2022] DELETE /identity/v3/users/853018fe45194f6d96b4c635b966ff2b => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:14.428394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 935/1899] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:14 2022] DELETE /identity/v3/users/afb3affc4dff4783903882501ca95c15 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:14.432931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce2f0-2450-4f72-a194-5650c12fd4ec None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:14.433227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce2f0-2450-4f72-a194-5650c12fd4ec None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:14.433506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ce2f0-2450-4f72-a194-5650c12fd4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:14.454001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-230ce2f0-2450-4f72-a194-5650c12fd4ec None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:14.455223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-230ce2f0-2450-4f72-a194-5650c12fd4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:14.516760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 965/1900] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:14.526836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:14.528337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:14.591502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d738766-339c-4845-bc35-5fde869b622f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:14.596412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae09542-d8de-47d9-8571-12e056cd3d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:14.597362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09542-d8de-47d9-8571-12e056cd3d60 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:14.597946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09542-d8de-47d9-8571-12e056cd3d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:14.598569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09542-d8de-47d9-8571-12e056cd3d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:14.616399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae09542-d8de-47d9-8571-12e056cd3d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:14.618523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae09542-d8de-47d9-8571-12e056cd3d60 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:14.632919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 936/1901] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:14.808820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce2f0-2450-4f72-a194-5650c12fd4ec None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:14.810311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-230ce2f0-2450-4f72-a194-5650c12fd4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:14.822831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ce2f0-2450-4f72-a194-5650c12fd4ec None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:14.829743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:14.831065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:14.831404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:14.831670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] PATH_INFO: `/v3/projects/88fdcfe2ac3d4e6bb6676247a5585dde` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:14.833020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=88fdcfe2ac3d4e6bb6676247a5585dde)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:14.835179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:14.837469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:14.970099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88fdcfe2ac3d4e6bb6676247a5585dde', 'request_id': 'req-3abc4b09-318e-4da8-8010-e64584924bbe'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:14.977345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:14.981800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88fdcfe2ac3d4e6bb6676247a5585dde', 'request_id': 'req-3abc4b09-318e-4da8-8010-e64584924bbe'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.076753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88fdcfe2ac3d4e6bb6676247a5585dde', 'request_id': 'req-3abc4b09-318e-4da8-8010-e64584924bbe'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.088978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] The token cache is being invalidate because project 88fdcfe2ac3d4e6bb6676247a5585dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:15.089363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.090198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3abc4b09-318e-4da8-8010-e64584924bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.091895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 966/1902] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:14 2022] DELETE /identity/v3/projects/88fdcfe2ac3d4e6bb6676247a5585dde => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:15.097802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a316e-4624-4bd3-847d-70e24fbb1387 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.098090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a316e-4624-4bd3-847d-70e24fbb1387 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.098364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a316e-4624-4bd3-847d-70e24fbb1387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.126757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9c4a316e-4624-4bd3-847d-70e24fbb1387 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:15.128618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9c4a316e-4624-4bd3-847d-70e24fbb1387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:15.257814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 937/1903] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:15.265790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a42037-59d9-4a09-99ae-114c40fe286e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.266332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a42037-59d9-4a09-99ae-114c40fe286e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.266824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a42037-59d9-4a09-99ae-114c40fe286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.293569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e4a42037-59d9-4a09-99ae-114c40fe286e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:15.300409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e4a42037-59d9-4a09-99ae-114c40fe286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:15.310840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 967/1904] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:15.315471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a316e-4624-4bd3-847d-70e24fbb1387 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:15.328373 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a316e-4624-4bd3-847d-70e24fbb1387 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:15.334626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:15.335436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.335887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.336384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.338223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:15.350195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:15.350195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:15.355971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a42037-59d9-4a09-99ae-114c40fe286e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:15.357575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e4a42037-59d9-4a09-99ae-114c40fe286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:15.384099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 938/1905] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:15.386699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:15.393952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a42037-59d9-4a09-99ae-114c40fe286e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:15.411750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f893e-96fb-43a7-a92a-08edbd907b31 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:15.415583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:15.419916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.419916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.419916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] PATH_INFO: `/v3/projects/eb6d8ec2c986451e8808c803193731b4` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.425126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6d8ec2c986451e8808c803193731b4)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:15.427133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:15.437386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3831dc-d54a-4588-85ee-efcbc97fac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:15.438489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3831dc-d54a-4588-85ee-efcbc97fac4f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.438777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3831dc-d54a-4588-85ee-efcbc97fac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.439050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3831dc-d54a-4588-85ee-efcbc97fac4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.440399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3831dc-d54a-4588-85ee-efcbc97fac4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:15.444898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3831dc-d54a-4588-85ee-efcbc97fac4f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:15.551797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 939/1906] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:15 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:15.556032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3831dc-d54a-4588-85ee-efcbc97fac4f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:15.571089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6d8ec2c986451e8808c803193731b4', 'request_id': 'req-69195ab0-65ca-4f1c-95bf-3b75c6c75159'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.583654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6d8ec2c986451e8808c803193731b4', 'request_id': 'req-69195ab0-65ca-4f1c-95bf-3b75c6c75159'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.639590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3831dc-d54a-4588-85ee-efcbc97fac4f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:15.674673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6d8ec2c986451e8808c803193731b4', 'request_id': 'req-69195ab0-65ca-4f1c-95bf-3b75c6c75159'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.691229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] The token cache is being invalidate because project eb6d8ec2c986451e8808c803193731b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:15.691913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.692876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.694903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 968/1907] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:15 2022] DELETE /identity/v3/projects/eb6d8ec2c986451e8808c803193731b4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:15.701408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:15.703882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:15.723627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:15.724466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.724929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.725351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.726162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:15.728459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:15.779065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69195ab0-65ca-4f1c-95bf-3b75c6c75159 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:15.784134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:15.784839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.785055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.785330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] PATH_INFO: `/v3/users/414d4b43de9a4115b918c5226eaed637` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.786470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=414d4b43de9a4115b918c5226eaed637)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:15.788423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:15.849007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 940/1908] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:15 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:15.853195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:15.854862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:15.867036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b37793-4089-4801-885b-f747b604bf81 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:15.871891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d6455-dc39-4440-bae4-b7a61e019622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:15.872495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d6455-dc39-4440-bae4-b7a61e019622 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.872776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d6455-dc39-4440-bae4-b7a61e019622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.873049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d6455-dc39-4440-bae4-b7a61e019622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.875991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d6455-dc39-4440-bae4-b7a61e019622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:15.875991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d6455-dc39-4440-bae4-b7a61e019622 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:15.886746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 941/1909] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:15.890879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d6455-dc39-4440-bae4-b7a61e019622 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:15.900303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d6455-dc39-4440-bae4-b7a61e019622 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:15.904884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b625e-063f-4305-90c4-b9eca53854d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:15.905458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b625e-063f-4305-90c4-b9eca53854d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.905777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b625e-063f-4305-90c4-b9eca53854d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.906053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b625e-063f-4305-90c4-b9eca53854d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.906681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b625e-063f-4305-90c4-b9eca53854d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:15.908248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b625e-063f-4305-90c4-b9eca53854d4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:15.918988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 942/1910] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:15.922873 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b625e-063f-4305-90c4-b9eca53854d4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:15.932847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b625e-063f-4305-90c4-b9eca53854d4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:15.937539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7429ec-ded3-4851-8088-46f2e06428f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:15.938422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7429ec-ded3-4851-8088-46f2e06428f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:15.938781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7429ec-ded3-4851-8088-46f2e06428f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:15.939108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7429ec-ded3-4851-8088-46f2e06428f0 admin admin] PATH_INFO: `/v3/projects/232d08a286e54c1d9aca41c095e4f759/users/02e97f24c8a64382b5051182d9cdc3a9/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:15.945507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414d4b43de9a4115b918c5226eaed637'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.946822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414d4b43de9a4115b918c5226eaed637'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.947454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414d4b43de9a4115b918c5226eaed637'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:15.954359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7429ec-ded3-4851-8088-46f2e06428f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232d08a286e54c1d9aca41c095e4f759, user_id=02e97f24c8a64382b5051182d9cdc3a9, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:15.957410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7429ec-ded3-4851-8088-46f2e06428f0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:16.021630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414d4b43de9a4115b918c5226eaed637'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:16.027823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 943/1911] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:15 2022] PUT /identity/v3/projects/232d08a286e54c1d9aca41c095e4f759/users/02e97f24c8a64382b5051182d9cdc3a9/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:16.039495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0bfb-0bd0-4405-8a3a-7eae5a113371 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.039797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0bfb-0bd0-4405-8a3a-7eae5a113371 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.040081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf0bfb-0bd0-4405-8a3a-7eae5a113371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.043726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414d4b43de9a4115b918c5226eaed637'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:16.058232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 969/1912] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:15 2022] DELETE /identity/v3/users/414d4b43de9a4115b918c5226eaed637 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:16.076878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c4cf0bfb-0bd0-4405-8a3a-7eae5a113371 None None] MFA Rules not processed for user `02e97f24c8a64382b5051182d9cdc3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:16.078142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c4cf0bfb-0bd0-4405-8a3a-7eae5a113371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:16.151091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 944/1913] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:16.155649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:16.157062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:16.228597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bba3c7-d67b-4cc5-8bd6-c2182ddd37ad admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:16.233643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00c326-50a2-4a81-81d8-a4d4dfdfd984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:16.234375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c326-50a2-4a81-81d8-a4d4dfdfd984 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.234722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c326-50a2-4a81-81d8-a4d4dfdfd984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.235076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c326-50a2-4a81-81d8-a4d4dfdfd984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.235776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00c326-50a2-4a81-81d8-a4d4dfdfd984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:16.238475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00c326-50a2-4a81-81d8-a4d4dfdfd984 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:16.337805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 970/1914] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:16 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:16.343089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf0bfb-0bd0-4405-8a3a-7eae5a113371 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:16.354009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf0bfb-0bd0-4405-8a3a-7eae5a113371 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:16.424955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba60b5-6f00-4599-9f2c-00ed09373f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:16.425662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba60b5-6f00-4599-9f2c-00ed09373f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.425909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba60b5-6f00-4599-9f2c-00ed09373f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.426227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba60b5-6f00-4599-9f2c-00ed09373f75 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.426848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba60b5-6f00-4599-9f2c-00ed09373f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:16.429153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba60b5-6f00-4599-9f2c-00ed09373f75 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:16.502376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00c326-50a2-4a81-81d8-a4d4dfdfd984 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:16.507631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 945/1915] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:16 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:16.528331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00c326-50a2-4a81-81d8-a4d4dfdfd984 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:16.541118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:16.542051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.542503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.543109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.544227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:16.546368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:16.560700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 971/1916] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:16.564991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba60b5-6f00-4599-9f2c-00ed09373f75 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:16.582651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba60b5-6f00-4599-9f2c-00ed09373f75 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:16.597319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ea2e-463e-4df2-83d8-11d9473f2f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:16.598149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ea2e-463e-4df2-83d8-11d9473f2f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.598492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ea2e-463e-4df2-83d8-11d9473f2f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.598860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ea2e-463e-4df2-83d8-11d9473f2f9a admin admin] PATH_INFO: `/v3/projects/2de78b47f7d94f6b9a30d9a820e259c5/users/a876150e2f2b4ca3a28ed3dbca3afd81/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.618531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ea2e-463e-4df2-83d8-11d9473f2f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de78b47f7d94f6b9a30d9a820e259c5, user_id=a876150e2f2b4ca3a28ed3dbca3afd81, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:16.622928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ea2e-463e-4df2-83d8-11d9473f2f9a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:16.688362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:16.690771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:16.712488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c307d67-7056-46ef-b816-50e51b33b5ce admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:16.719812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 946/1917] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:16 2022] PUT /identity/v3/projects/2de78b47f7d94f6b9a30d9a820e259c5/users/a876150e2f2b4ca3a28ed3dbca3afd81/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:16.723528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ea2e-463e-4df2-83d8-11d9473f2f9a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:16.821697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:16.823476 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.823762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.824040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] PATH_INFO: `/v3/projects/e7a50811838e4563b87c071ac9d3c9ef` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.840070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a50811838e4563b87c071ac9d3c9ef)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:16.842183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:16.864257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ea2e-463e-4df2-83d8-11d9473f2f9a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:16.875554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74cbe-60b6-4540-bd34-758a88b19fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:16.875554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74cbe-60b6-4540-bd34-758a88b19fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.875554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74cbe-60b6-4540-bd34-758a88b19fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.878030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74cbe-60b6-4540-bd34-758a88b19fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.878845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be74cbe-60b6-4540-bd34-758a88b19fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:16.880604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be74cbe-60b6-4540-bd34-758a88b19fe1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:16.895958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 947/1918] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:16.899165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74cbe-60b6-4540-bd34-758a88b19fe1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:16.912752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74cbe-60b6-4540-bd34-758a88b19fe1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:16.918013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d255c27-efa1-4bea-bb27-7a3c4d2812d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:16.919135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d255c27-efa1-4bea-bb27-7a3c4d2812d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.919811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d255c27-efa1-4bea-bb27-7a3c4d2812d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.919811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d255c27-efa1-4bea-bb27-7a3c4d2812d7 admin admin] PATH_INFO: `/v3/projects/2de78b47f7d94f6b9a30d9a820e259c5/users/a876150e2f2b4ca3a28ed3dbca3afd81/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.922312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d255c27-efa1-4bea-bb27-7a3c4d2812d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de78b47f7d94f6b9a30d9a820e259c5, user_id=a876150e2f2b4ca3a28ed3dbca3afd81, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:16.923075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:16.925143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d255c27-efa1-4bea-bb27-7a3c4d2812d7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:16.936737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 948/1919] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:16 2022] PUT /identity/v3/projects/2de78b47f7d94f6b9a30d9a820e259c5/users/a876150e2f2b4ca3a28ed3dbca3afd81/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:16.948741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab15b2-f692-4e1f-8239-94de4b597072 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:16.949056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab15b2-f692-4e1f-8239-94de4b597072 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:16.949317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab15b2-f692-4e1f-8239-94de4b597072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:16.984291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-76ab15b2-f692-4e1f-8239-94de4b597072 None None] MFA Rules not processed for user `a876150e2f2b4ca3a28ed3dbca3afd81`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:16.985749 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-76ab15b2-f692-4e1f-8239-94de4b597072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:16.993306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:17.002959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a50811838e4563b87c071ac9d3c9ef', 'request_id': 'req-143e82a4-6a5c-44eb-8d16-19a18b11f297'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:17.010690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a50811838e4563b87c071ac9d3c9ef', 'request_id': 'req-143e82a4-6a5c-44eb-8d16-19a18b11f297'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:17.068257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 949/1920] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:17.176708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a50811838e4563b87c071ac9d3c9ef', 'request_id': 'req-143e82a4-6a5c-44eb-8d16-19a18b11f297'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:17.187984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] The token cache is being invalidate because project e7a50811838e4563b87c071ac9d3c9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:17.188277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:17.188948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-143e82a4-6a5c-44eb-8d16-19a18b11f297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:17.191160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 972/1921] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:16 2022] DELETE /identity/v3/projects/e7a50811838e4563b87c071ac9d3c9ef => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:17.196077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f09f9-11a9-47b6-abc8-f3fb52060b1a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.196372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f09f9-11a9-47b6-abc8-f3fb52060b1a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.196651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f09f9-11a9-47b6-abc8-f3fb52060b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.216014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f02f09f9-11a9-47b6-abc8-f3fb52060b1a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:17.217291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f02f09f9-11a9-47b6-abc8-f3fb52060b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:17.278864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 950/1922] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:17.288085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282189-1e73-4deb-a71d-1ab25c540d4b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.288375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282189-1e73-4deb-a71d-1ab25c540d4b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.288653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73282189-1e73-4deb-a71d-1ab25c540d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.310703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-73282189-1e73-4deb-a71d-1ab25c540d4b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:17.311915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-73282189-1e73-4deb-a71d-1ab25c540d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:17.320622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 973/1923] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:17.325122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f09f9-11a9-47b6-abc8-f3fb52060b1a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:17.336080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f09f9-11a9-47b6-abc8-f3fb52060b1a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:17.341745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:17.342568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.343052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.343547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.344399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:17.344776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:17.346478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:17.360144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 951/1924] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:17.365363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282189-1e73-4deb-a71d-1ab25c540d4b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:17.374568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73282189-1e73-4deb-a71d-1ab25c540d4b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:17.379971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6ea80-a054-46ad-88de-c1b56ea4ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:17.380573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ea80-a054-46ad-88de-c1b56ea4ab39 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.380854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ea80-a054-46ad-88de-c1b56ea4ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.381127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ea80-a054-46ad-88de-c1b56ea4ab39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.381787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6ea80-a054-46ad-88de-c1b56ea4ab39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:17.383688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6ea80-a054-46ad-88de-c1b56ea4ab39 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:17.508468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 974/1925] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:17 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:17.509576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:17.519790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803824d4-01dd-4a0f-9f70-692f9a990f62 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:17.577800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:17.578416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.578699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.578968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.579637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:17.581719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:17.677886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 952/1926] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:17 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:17.682086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6ea80-a054-46ad-88de-c1b56ea4ab39 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:17.693190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6ea80-a054-46ad-88de-c1b56ea4ab39 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:17.698011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e385a-1958-489d-9409-85bab08a2f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:17.698624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e385a-1958-489d-9409-85bab08a2f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.698911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e385a-1958-489d-9409-85bab08a2f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.699355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e385a-1958-489d-9409-85bab08a2f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.700030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e385a-1958-489d-9409-85bab08a2f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:17.701662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e385a-1958-489d-9409-85bab08a2f85 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:17.731422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:17.734650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:17.751282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 975/1927] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:17.754816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e385a-1958-489d-9409-85bab08a2f85 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:17.771094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e385a-1958-489d-9409-85bab08a2f85 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:17.789769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e258d9-6fb4-42a9-ad94-42a00fb85ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:17.790716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e258d9-6fb4-42a9-ad94-42a00fb85ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.791090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e258d9-6fb4-42a9-ad94-42a00fb85ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.791412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e258d9-6fb4-42a9-ad94-42a00fb85ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.792291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e258d9-6fb4-42a9-ad94-42a00fb85ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:17.794429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e258d9-6fb4-42a9-ad94-42a00fb85ee3 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:17.797044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:17.812289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 976/1928] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:17.813380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e258d9-6fb4-42a9-ad94-42a00fb85ee3 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:17.823545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e258d9-6fb4-42a9-ad94-42a00fb85ee3 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:17.828817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:17.829478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.829850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.830095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] PATH_INFO: `/v3/projects/b72d7e8d00a84d54b3c814e869f07d99/users/d788449dcdb54f78868f2c0405334876/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.848312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72d7e8d00a84d54b3c814e869f07d99, user_id=d788449dcdb54f78868f2c0405334876, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:17.855109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:17.855211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7d47-c707-495f-90d3-de3fffd55061 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:17.855672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317303b-0d54-4389-944b-92b0764cda17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:17.856351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317303b-0d54-4389-944b-92b0764cda17 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.856636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317303b-0d54-4389-944b-92b0764cda17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.856912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317303b-0d54-4389-944b-92b0764cda17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:17.858966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a317303b-0d54-4389-944b-92b0764cda17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:17.936359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317303b-0d54-4389-944b-92b0764cda17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:17.938276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317303b-0d54-4389-944b-92b0764cda17 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:17.957182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 953/1929] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:17.979991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 977/1930] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:17 2022] PUT /identity/v3/projects/b72d7e8d00a84d54b3c814e869f07d99/users/d788449dcdb54f78868f2c0405334876/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:17.990713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf73665-8e7f-45a2-bf6c-0f5fd114e107 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:17.991005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf73665-8e7f-45a2-bf6c-0f5fd114e107 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:17.991275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf73665-8e7f-45a2-bf6c-0f5fd114e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:18.020584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bbf73665-8e7f-45a2-bf6c-0f5fd114e107 None None] MFA Rules not processed for user `d788449dcdb54f78868f2c0405334876`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:18.022005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bbf73665-8e7f-45a2-bf6c-0f5fd114e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:18.107553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 954/1931] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:18.118188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:18.120213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:18.210761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed0772-40b7-4ffc-a7b9-2ae36b04d302 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:18.216166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:18.216974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:18.217358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:18.217807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:18.230181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:18.234698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:18.255710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 978/1932] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:18.278925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf73665-8e7f-45a2-bf6c-0f5fd114e107 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:18.364333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf73665-8e7f-45a2-bf6c-0f5fd114e107 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:18.369821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:18.370478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:18.370761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:18.371035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] PATH_INFO: `/v3/users/d788449dcdb54f78868f2c0405334876` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:18.372403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d788449dcdb54f78868f2c0405334876)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:18.374378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:18.419599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:18.629487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:18.630957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:18.653104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e372d-a2d0-4e20-b424-97d0b770768c service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:18.655006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd788449dcdb54f78868f2c0405334876'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:18.657688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:18.658297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:18.658594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:18.658860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] PATH_INFO: `/v3/users/02e97f24c8a64382b5051182d9cdc3a9` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:18.659996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e97f24c8a64382b5051182d9cdc3a9)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:18.661956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:18.662089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd788449dcdb54f78868f2c0405334876'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:18.662848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd788449dcdb54f78868f2c0405334876'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:18.663474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd788449dcdb54f78868f2c0405334876'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:18.676343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-09f31e2b-4f93-4dd9-8253-517f814a240f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd788449dcdb54f78868f2c0405334876'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:18.750641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 955/1933] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:18 2022] DELETE /identity/v3/users/d788449dcdb54f78868f2c0405334876 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:18.755641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b750ab-f4b5-45fe-98fe-154b5f3d14f8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:18.755959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b750ab-f4b5-45fe-98fe-154b5f3d14f8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:18.756236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b750ab-f4b5-45fe-98fe-154b5f3d14f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:18.775477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d5b750ab-f4b5-45fe-98fe-154b5f3d14f8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:18.776311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d5b750ab-f4b5-45fe-98fe-154b5f3d14f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:18.862311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 956/1934] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:18.869091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b750ab-f4b5-45fe-98fe-154b5f3d14f8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:18.870674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d5b750ab-f4b5-45fe-98fe-154b5f3d14f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:18.898428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e97f24c8a64382b5051182d9cdc3a9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:18.899223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e97f24c8a64382b5051182d9cdc3a9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:18.899986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e97f24c8a64382b5051182d9cdc3a9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:18.993766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b750ab-f4b5-45fe-98fe-154b5f3d14f8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:18.998104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:18.998809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:18.999138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:18.999489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:19.002346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:19.008235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e97f24c8a64382b5051182d9cdc3a9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:19.039598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4cc4efae-f3c4-475b-80f9-2e90d96e4768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e97f24c8a64382b5051182d9cdc3a9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:19.045989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:19.051493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:19.066102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 979/1935] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:18 2022] DELETE /identity/v3/users/02e97f24c8a64382b5051182d9cdc3a9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:19.070797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a619-f822-4cf3-9a55-b6563b13c17d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:19.071089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a619-f822-4cf3-9a55-b6563b13c17d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:19.071373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a619-f822-4cf3-9a55-b6563b13c17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:19.074833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 957/1936] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:19.128986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e4d1a619-f822-4cf3-9a55-b6563b13c17d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:19.130560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e4d1a619-f822-4cf3-9a55-b6563b13c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:19.209651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 980/1937] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:19.219052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:19.220516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:19.235325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d1941-232a-46cb-92b1-10c046787d0c service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:19.285799 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1a619-f822-4cf3-9a55-b6563b13c17d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:19.287375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e4d1a619-f822-4cf3-9a55-b6563b13c17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:19.306237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1a619-f822-4cf3-9a55-b6563b13c17d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:19.312158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:19.312812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:19.313102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:19.313381 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] PATH_INFO: `/v3/users/47432485789243e1b40043fab85ee123` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:19.315320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47432485789243e1b40043fab85ee123)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:19.317462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:19.349342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:19.372919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:19.373222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:19.373480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:19.422894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:19.424574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:19.452941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 958/1938] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:19.663743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47432485789243e1b40043fab85ee123'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:19.664669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47432485789243e1b40043fab85ee123'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:19.665281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47432485789243e1b40043fab85ee123'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:19.796530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47432485789243e1b40043fab85ee123'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:19.824125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:19.825688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:19.831169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e9bd803-f19f-4a94-84c2-788afeeb5b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47432485789243e1b40043fab85ee123'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:19.848060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 981/1939] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:19 2022] DELETE /identity/v3/users/47432485789243e1b40043fab85ee123 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:19.855043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5444d13-02fc-4ca0-b142-2cfff37cfab6 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:19.855043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5444d13-02fc-4ca0-b142-2cfff37cfab6 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:19.855043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5444d13-02fc-4ca0-b142-2cfff37cfab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:19.860191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e294d-8fea-4aa8-863a-d479311d7497 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:19.881885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b5444d13-02fc-4ca0-b142-2cfff37cfab6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:19.883127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b5444d13-02fc-4ca0-b142-2cfff37cfab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:19.946200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:19.946946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:19.947449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:19.947547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] PATH_INFO: `/v3/projects/b72d7e8d00a84d54b3c814e869f07d99` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:19.952393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72d7e8d00a84d54b3c814e869f07d99)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:19.952393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:19.997669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 982/1940] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:20.007490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5444d13-02fc-4ca0-b142-2cfff37cfab6 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:20.009136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b5444d13-02fc-4ca0-b142-2cfff37cfab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:20.076601 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5444d13-02fc-4ca0-b142-2cfff37cfab6 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:20.080801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bbd36-7504-44bc-abea-3c74bcd48d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:20.081420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbd36-7504-44bc-abea-3c74bcd48d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.081722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbd36-7504-44bc-abea-3c74bcd48d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.081998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbd36-7504-44bc-abea-3c74bcd48d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.091517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bbd36-7504-44bc-abea-3c74bcd48d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:20.092996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bbd36-7504-44bc-abea-3c74bcd48d6f service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:20.103716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 983/1941] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:20.109364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:20.141478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72d7e8d00a84d54b3c814e869f07d99', 'request_id': 'req-b29f567c-f1f7-44f6-b22d-182460239556'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.214108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72d7e8d00a84d54b3c814e869f07d99', 'request_id': 'req-b29f567c-f1f7-44f6-b22d-182460239556'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.221368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72d7e8d00a84d54b3c814e869f07d99', 'request_id': 'req-b29f567c-f1f7-44f6-b22d-182460239556'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.232318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] The token cache is being invalidate because project b72d7e8d00a84d54b3c814e869f07d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:20.232603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.233291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b29f567c-f1f7-44f6-b22d-182460239556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.234822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 959/1942] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:19 2022] DELETE /identity/v3/projects/b72d7e8d00a84d54b3c814e869f07d99 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:20.240473 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8886e97-f610-4ee6-a16e-ddec30d7def7 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.240771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8886e97-f610-4ee6-a16e-ddec30d7def7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.241062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8886e97-f610-4ee6-a16e-ddec30d7def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.262559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e8886e97-f610-4ee6-a16e-ddec30d7def7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:20.263900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e8886e97-f610-4ee6-a16e-ddec30d7def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:20.347869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 984/1943] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:20.351376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a41b0-061e-4a16-b415-f5c9d4d95486 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.351689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a41b0-061e-4a16-b415-f5c9d4d95486 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.351944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a41b0-061e-4a16-b415-f5c9d4d95486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.391560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-834a41b0-061e-4a16-b415-f5c9d4d95486 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:20.393173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-834a41b0-061e-4a16-b415-f5c9d4d95486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:20.405365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 960/1944] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:20.406669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8886e97-f610-4ee6-a16e-ddec30d7def7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:20.418925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a41b0-061e-4a16-b415-f5c9d4d95486 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:20.419861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8886e97-f610-4ee6-a16e-ddec30d7def7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:20.421636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-834a41b0-061e-4a16-b415-f5c9d4d95486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:20.426105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:20.426721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.427011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.427348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.428020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:20.428327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:20.430174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:20.444472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 985/1945] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:20.446814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a41b0-061e-4a16-b415-f5c9d4d95486 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:20.451881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:20.463166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:20.464046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.464404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.464751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] PATH_INFO: `/v3/projects/232d08a286e54c1d9aca41c095e4f759` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.466418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232d08a286e54c1d9aca41c095e4f759)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:20.472769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:20.473232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6413132-b5ad-4764-805a-39a192343430 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:20.487364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2179c-2d35-4272-ab96-67840e61d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:20.488087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2179c-2d35-4272-ab96-67840e61d334 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.488446 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2179c-2d35-4272-ab96-67840e61d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.489287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2179c-2d35-4272-ab96-67840e61d334 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.489494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2179c-2d35-4272-ab96-67840e61d334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:20.493045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2179c-2d35-4272-ab96-67840e61d334 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:20.600444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:20.623829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232d08a286e54c1d9aca41c095e4f759', 'request_id': 'req-2c9d1bd5-810a-42b8-b756-794a48c68e21'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.625034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 986/1946] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:20 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:20.631155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2179c-2d35-4272-ab96-67840e61d334 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:20.707860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232d08a286e54c1d9aca41c095e4f759', 'request_id': 'req-2c9d1bd5-810a-42b8-b756-794a48c68e21'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.709502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2179c-2d35-4272-ab96-67840e61d334 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:20.715412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:20.715596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.715904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.716183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.716818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:20.718620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232d08a286e54c1d9aca41c095e4f759', 'request_id': 'req-2c9d1bd5-810a-42b8-b756-794a48c68e21'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.719258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:20.766123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] The token cache is being invalidate because project 232d08a286e54c1d9aca41c095e4f759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:20.766633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.767487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:20.770571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 961/1947] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:20 2022] DELETE /identity/v3/projects/232d08a286e54c1d9aca41c095e4f759 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:20.775362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:20.777152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:20.860163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1bd5-810a-42b8-b756-794a48c68e21 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:20.868157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 987/1948] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:20 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:20.868880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:20.872549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:20.873973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:20.874797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.875360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.875741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] PATH_INFO: `/v3/users/a876150e2f2b4ca3a28ed3dbca3afd81` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.878359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a876150e2f2b4ca3a28ed3dbca3afd81)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:20.880742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:20.902766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53799de-c3a1-4526-9f02-75eba6cd2869 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:20.921418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:20.922343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:20.922732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:20.923203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] PATH_INFO: `/v3/projects/0f53411098674788915e12e1058b39a0` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:20.925848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f53411098674788915e12e1058b39a0)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:20.939450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:21.242926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f53411098674788915e12e1058b39a0', 'request_id': 'req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.251624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f53411098674788915e12e1058b39a0', 'request_id': 'req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.252680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a876150e2f2b4ca3a28ed3dbca3afd81'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.271710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a876150e2f2b4ca3a28ed3dbca3afd81'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.272480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a876150e2f2b4ca3a28ed3dbca3afd81'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.273112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a876150e2f2b4ca3a28ed3dbca3afd81'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.307892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a876150e2f2b4ca3a28ed3dbca3afd81'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.405889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f53411098674788915e12e1058b39a0', 'request_id': 'req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.423822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] The token cache is being invalidate because project 0f53411098674788915e12e1058b39a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:21.424541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.425447 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.429277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 988/1949] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:20 2022] DELETE /identity/v3/projects/0f53411098674788915e12e1058b39a0 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:21.430846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:21.432358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:21.523159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a6dfb-158f-4f34-9e51-57c8213cf9ed admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:21.529824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:21.531855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:21.531855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:21.531855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:21.532136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:21.533985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:21.546310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 989/1950] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:21.547192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:21.550571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:21.566602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295031c-3409-4b68-8ca5-64b459216a13 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:21.571902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:21.572723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:21.573107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:21.573456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] PATH_INFO: `/v3/users/c081e0011d2d4ad5be4e10840d88e9be` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:21.574896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c081e0011d2d4ad5be4e10840d88e9be)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:21.577231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:21.591329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 962/1951] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:20 2022] DELETE /identity/v3/users/a876150e2f2b4ca3a28ed3dbca3afd81 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:21.593017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:21.595890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:21.702883 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678b16a-7679-4628-afbb-d98c529d9809 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:21.726343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ba4d4-74b1-4ce2-96e1-6a29756c2130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:21.726343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ba4d4-74b1-4ce2-96e1-6a29756c2130 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:21.726343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ba4d4-74b1-4ce2-96e1-6a29756c2130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:21.726343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ba4d4-74b1-4ce2-96e1-6a29756c2130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:21.726637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ba4d4-74b1-4ce2-96e1-6a29756c2130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:21.726637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ba4d4-74b1-4ce2-96e1-6a29756c2130 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:21.740209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 963/1952] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:21.744122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ba4d4-74b1-4ce2-96e1-6a29756c2130 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:21.773392 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ba4d4-74b1-4ce2-96e1-6a29756c2130 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:21.779240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3c51-cab1-43ae-b0dd-bcb1d12374a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:21.780595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3c51-cab1-43ae-b0dd-bcb1d12374a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:21.781090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3c51-cab1-43ae-b0dd-bcb1d12374a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:21.781431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3c51-cab1-43ae-b0dd-bcb1d12374a9 admin admin] PATH_INFO: `/v3/projects/35ec9234b44a4c46b67433d4519f2db3/users/3cd4322a10e846aa8d1d37afe7a4a5d9/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:21.831138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf3c51-cab1-43ae-b0dd-bcb1d12374a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ec9234b44a4c46b67433d4519f2db3, user_id=3cd4322a10e846aa8d1d37afe7a4a5d9, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:21.833871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf3c51-cab1-43ae-b0dd-bcb1d12374a9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:21.888427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c081e0011d2d4ad5be4e10840d88e9be'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.889212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c081e0011d2d4ad5be4e10840d88e9be'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.890097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c081e0011d2d4ad5be4e10840d88e9be'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:21.960448 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 964/1953] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:21 2022] PUT /identity/v3/projects/35ec9234b44a4c46b67433d4519f2db3/users/3cd4322a10e846aa8d1d37afe7a4a5d9/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:21.974801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1597d3-530d-4485-a30b-3d7397aeae10 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:21.975092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1597d3-530d-4485-a30b-3d7397aeae10 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:21.975369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1597d3-530d-4485-a30b-3d7397aeae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:22.010254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ea1597d3-530d-4485-a30b-3d7397aeae10 None None] MFA Rules not processed for user `3cd4322a10e846aa8d1d37afe7a4a5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:22.011684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ea1597d3-530d-4485-a30b-3d7397aeae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:22.016858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c081e0011d2d4ad5be4e10840d88e9be'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:22.032127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c081e0011d2d4ad5be4e10840d88e9be'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:22.055882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 990/1954] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:21 2022] DELETE /identity/v3/users/c081e0011d2d4ad5be4e10840d88e9be => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:22.176754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 965/1955] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:22.189521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:22.192170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:22.295110 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa709-a176-4eb7-a0f3-ef3eb41e047b admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:22.302840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8070d1891844da59196d00ebbdff832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:22.303606 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:22.303994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:22.304371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:22.382184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:22.384449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:22.397425 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 991/1956] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:22.442618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:22.789853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1597d3-530d-4485-a30b-3d7397aeae10 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:22.791626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ea1597d3-530d-4485-a30b-3d7397aeae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:22.824951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:22.826847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:22.895299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1597d3-530d-4485-a30b-3d7397aeae10 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:23.032594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:23.040286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14900776-6f2c-4fbc-921d-e65915b70ba8 service glance] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:23.047958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:23.047958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.047958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.047958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] PATH_INFO: `/v3/projects/c2f70afd62be4c81814cbd5ab6631dd8` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.050593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f70afd62be4c81814cbd5ab6631dd8)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:23.053946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:23.063142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:23.063871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.064157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.064435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] PATH_INFO: `/v3/projects/2de78b47f7d94f6b9a30d9a820e259c5` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.066677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de78b47f7d94f6b9a30d9a820e259c5)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:23.068753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:23.245934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de78b47f7d94f6b9a30d9a820e259c5', 'request_id': 'req-649f249a-e52b-4d97-b9ca-63769e9e48e9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.273985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f70afd62be4c81814cbd5ab6631dd8', 'request_id': 'req-97de410d-159e-4deb-ac51-b82b3a747d56'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.280666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f70afd62be4c81814cbd5ab6631dd8', 'request_id': 'req-97de410d-159e-4deb-ac51-b82b3a747d56'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.382567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de78b47f7d94f6b9a30d9a820e259c5', 'request_id': 'req-649f249a-e52b-4d97-b9ca-63769e9e48e9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.392542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de78b47f7d94f6b9a30d9a820e259c5', 'request_id': 'req-649f249a-e52b-4d97-b9ca-63769e9e48e9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.403087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] The token cache is being invalidate because project 2de78b47f7d94f6b9a30d9a820e259c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:23.403383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.404197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-649f249a-e52b-4d97-b9ca-63769e9e48e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.406106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 966/1957] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:22 2022] DELETE /identity/v3/projects/2de78b47f7d94f6b9a30d9a820e259c5 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:23.411399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0eb12-9770-4885-89a5-b7eab4d2df57 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.411760 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0eb12-9770-4885-89a5-b7eab4d2df57 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.412145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0eb12-9770-4885-89a5-b7eab4d2df57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.434323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a1f0eb12-9770-4885-89a5-b7eab4d2df57 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:23.435705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a1f0eb12-9770-4885-89a5-b7eab4d2df57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:23.446746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f70afd62be4c81814cbd5ab6631dd8', 'request_id': 'req-97de410d-159e-4deb-ac51-b82b3a747d56'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.460740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] The token cache is being invalidate because project c2f70afd62be4c81814cbd5ab6631dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:23.461235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.461921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-97de410d-159e-4deb-ac51-b82b3a747d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:23.463634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 992/1958] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:22 2022] DELETE /identity/v3/projects/c2f70afd62be4c81814cbd5ab6631dd8 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:23.468816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf1a1-73a4-4cfa-94df-65dd2d2496c2 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.469737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf1a1-73a4-4cfa-94df-65dd2d2496c2 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.470088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf1a1-73a4-4cfa-94df-65dd2d2496c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.499279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ad4bf1a1-73a4-4cfa-94df-65dd2d2496c2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:23.500906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ad4bf1a1-73a4-4cfa-94df-65dd2d2496c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:23.506142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 967/1959] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:23.509598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 993/1960] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:23.515919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1cc0-3d06-40ef-9a2e-25d63c79c1b8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.516203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1cc0-3d06-40ef-9a2e-25d63c79c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.516476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1cc0-3d06-40ef-9a2e-25d63c79c1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.519625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5077-49fc-4b9d-ae75-1ddd1266b214 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.520135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5077-49fc-4b9d-ae75-1ddd1266b214 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.522152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d5077-49fc-4b9d-ae75-1ddd1266b214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.540573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a30b1cc0-3d06-40ef-9a2e-25d63c79c1b8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:23.540771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-468d5077-49fc-4b9d-ae75-1ddd1266b214 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:23.545100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a30b1cc0-3d06-40ef-9a2e-25d63c79c1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:23.545241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-468d5077-49fc-4b9d-ae75-1ddd1266b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:23.550710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 994/1961] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:23.551307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 968/1962] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:23.554721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d5077-49fc-4b9d-ae75-1ddd1266b214 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:23.566567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d5077-49fc-4b9d-ae75-1ddd1266b214 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:23.566661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1cc0-3d06-40ef-9a2e-25d63c79c1b8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:23.579177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1cc0-3d06-40ef-9a2e-25d63c79c1b8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:23.591769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:23.592451 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.594512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:23.595420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.595848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.596699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.596828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.597334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.597598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:23.597932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:23.598717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:23.599194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:23.601069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:23.601436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:23.625748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 995/1964] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:35:23.626137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 969/1964] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:23.628741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:23.628866 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:23.640897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d40c-930d-4b60-88c7-b9efd7d5942f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:23.647096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953403-23de-46e0-abb2-7b118219455f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:23.647648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7ac72-a084-4a3b-89f0-413cf9aec4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:23.648784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ac72-a084-4a3b-89f0-413cf9aec4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.649448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ac72-a084-4a3b-89f0-413cf9aec4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.650187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7ac72-a084-4a3b-89f0-413cf9aec4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.650963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7ac72-a084-4a3b-89f0-413cf9aec4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:23.653270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7ac72-a084-4a3b-89f0-413cf9aec4a3 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:23.660629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880871bb-26e6-4734-8944-82b76c3e06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:23.661250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880871bb-26e6-4734-8944-82b76c3e06e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.661524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880871bb-26e6-4734-8944-82b76c3e06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.661824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880871bb-26e6-4734-8944-82b76c3e06e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.662458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880871bb-26e6-4734-8944-82b76c3e06e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:23.694665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880871bb-26e6-4734-8944-82b76c3e06e5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:23.765484 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 996/1965] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:23 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:23.770397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7ac72-a084-4a3b-89f0-413cf9aec4a3 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:23.825932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 970/1966] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:23 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:23.829000 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880871bb-26e6-4734-8944-82b76c3e06e5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:23.882770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7ac72-a084-4a3b-89f0-413cf9aec4a3 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:23.918778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880871bb-26e6-4734-8944-82b76c3e06e5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:23.925011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb452a-5b11-42ee-ac7a-1c389a75e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:23.925841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb452a-5b11-42ee-ac7a-1c389a75e966 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.930347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb452a-5b11-42ee-ac7a-1c389a75e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.930347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb452a-5b11-42ee-ac7a-1c389a75e966 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.930347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb452a-5b11-42ee-ac7a-1c389a75e966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:23.930347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb452a-5b11-42ee-ac7a-1c389a75e966 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:23.955415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d76524-d69a-42f2-859b-54da4d31cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:23.956065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d76524-d69a-42f2-859b-54da4d31cf2f admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:23.956350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d76524-d69a-42f2-859b-54da4d31cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:23.956630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d76524-d69a-42f2-859b-54da4d31cf2f admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:23.957272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d76524-d69a-42f2-859b-54da4d31cf2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:23.959345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d76524-d69a-42f2-859b-54da4d31cf2f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.060640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 971/1967] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:23 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:24.062079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb452a-5b11-42ee-ac7a-1c389a75e966 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.072711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb452a-5b11-42ee-ac7a-1c389a75e966 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.077397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb688fa-2182-4449-a2b5-3e6c4d52f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.078188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb688fa-2182-4449-a2b5-3e6c4d52f31d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.078544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb688fa-2182-4449-a2b5-3e6c4d52f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.078892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb688fa-2182-4449-a2b5-3e6c4d52f31d admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.079617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb688fa-2182-4449-a2b5-3e6c4d52f31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.081409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb688fa-2182-4449-a2b5-3e6c4d52f31d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.089651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 997/1968] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:23 2022] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:24.095424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 972/1969] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:24.097067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb688fa-2182-4449-a2b5-3e6c4d52f31d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.097261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d76524-d69a-42f2-859b-54da4d31cf2f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.108516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d76524-d69a-42f2-859b-54da4d31cf2f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.109157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb688fa-2182-4449-a2b5-3e6c4d52f31d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.114336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5ac70-59a3-4da1-a0c5-7b07710f92d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.118182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50c125-6ce9-4cfd-9eab-1d6447a419a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.118322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ac70-59a3-4da1-a0c5-7b07710f92d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.118322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ac70-59a3-4da1-a0c5-7b07710f92d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.118489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50c125-6ce9-4cfd-9eab-1d6447a419a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.118575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5ac70-59a3-4da1-a0c5-7b07710f92d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.118676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50c125-6ce9-4cfd-9eab-1d6447a419a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.118676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50c125-6ce9-4cfd-9eab-1d6447a419a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.118834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5ac70-59a3-4da1-a0c5-7b07710f92d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.118927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50c125-6ce9-4cfd-9eab-1d6447a419a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.119545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5ac70-59a3-4da1-a0c5-7b07710f92d2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.121381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50c125-6ce9-4cfd-9eab-1d6447a419a4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.131733 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 998/1970] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:24.135836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5ac70-59a3-4da1-a0c5-7b07710f92d2 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.136040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 973/1971] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:24.140236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50c125-6ce9-4cfd-9eab-1d6447a419a4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.147177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5ac70-59a3-4da1-a0c5-7b07710f92d2 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.152472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50c125-6ce9-4cfd-9eab-1d6447a419a4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.154328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38bd8f-341a-43f7-b6bf-f28c3d1d1acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.155202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38bd8f-341a-43f7-b6bf-f28c3d1d1acf admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.155510 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38bd8f-341a-43f7-b6bf-f28c3d1d1acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.156723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38bd8f-341a-43f7-b6bf-f28c3d1d1acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.157466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38bd8f-341a-43f7-b6bf-f28c3d1d1acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.158196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba296f03-506f-4032-b12f-9500f0dddc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.159571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296f03-506f-4032-b12f-9500f0dddc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.160007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296f03-506f-4032-b12f-9500f0dddc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.160126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38bd8f-341a-43f7-b6bf-f28c3d1d1acf admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.160542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba296f03-506f-4032-b12f-9500f0dddc71 admin admin] PATH_INFO: `/v3/projects/1a123729cd66440793e93cbefe06ce17/users/70e458e99d4d4cc9b0cf726879e8d29f/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.174886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 999/1972] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:24.180221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38bd8f-341a-43f7-b6bf-f28c3d1d1acf admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.180491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba296f03-506f-4032-b12f-9500f0dddc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a123729cd66440793e93cbefe06ce17, user_id=70e458e99d4d4cc9b0cf726879e8d29f, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.181595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba296f03-506f-4032-b12f-9500f0dddc71 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.187142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38bd8f-341a-43f7-b6bf-f28c3d1d1acf admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.192821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd052b-7695-4ecb-b778-d2556066eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.193631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd052b-7695-4ecb-b778-d2556066eb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.193927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd052b-7695-4ecb-b778-d2556066eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.194209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd052b-7695-4ecb-b778-d2556066eb2e admin admin] PATH_INFO: `/v3/projects/f889692530994202a841f5e9b5d3f37a/users/e46133953e354d568dbeb98119d4416f/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.210433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd052b-7695-4ecb-b778-d2556066eb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f889692530994202a841f5e9b5d3f37a, user_id=e46133953e354d568dbeb98119d4416f, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.213161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd052b-7695-4ecb-b778-d2556066eb2e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.290063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 974/1973] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:24 2022] PUT /identity/v3/projects/1a123729cd66440793e93cbefe06ce17/users/70e458e99d4d4cc9b0cf726879e8d29f/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:24.301715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c930a-f504-4276-8e93-f73933a8ddee None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.301715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c930a-f504-4276-8e93-f73933a8ddee None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.301715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c930a-f504-4276-8e93-f73933a8ddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.309950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1000/1974] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:24 2022] PUT /identity/v3/projects/f889692530994202a841f5e9b5d3f37a/users/e46133953e354d568dbeb98119d4416f/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:24.322596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5a7f5-7989-45b4-b13b-9b7f95561148 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.322951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5a7f5-7989-45b4-b13b-9b7f95561148 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.323269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5a7f5-7989-45b4-b13b-9b7f95561148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.348385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-081c930a-f504-4276-8e93-f73933a8ddee None None] MFA Rules not processed for user `70e458e99d4d4cc9b0cf726879e8d29f`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:24.350382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-081c930a-f504-4276-8e93-f73933a8ddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:24.391951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:24.413405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-87b5a7f5-7989-45b4-b13b-9b7f95561148 None None] MFA Rules not processed for user `e46133953e354d568dbeb98119d4416f`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:24.414917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-87b5a7f5-7989-45b4-b13b-9b7f95561148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:24.472136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 975/1975] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:24.476789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c930a-f504-4276-8e93-f73933a8ddee None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.491685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1001/1976] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:24.496314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5a7f5-7989-45b4-b13b-9b7f95561148 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.541707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c930a-f504-4276-8e93-f73933a8ddee None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.547949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb13459-af37-4346-be8a-1ba561d5c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.548549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb13459-af37-4346-be8a-1ba561d5c8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.549968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb13459-af37-4346-be8a-1ba561d5c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.550280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb13459-af37-4346-be8a-1ba561d5c8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.550921 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb13459-af37-4346-be8a-1ba561d5c8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.553687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb13459-af37-4346-be8a-1ba561d5c8bf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.565648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5a7f5-7989-45b4-b13b-9b7f95561148 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.571293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836d5a-2605-4ae0-8e12-1332c4d48911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.572011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836d5a-2605-4ae0-8e12-1332c4d48911 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.572302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836d5a-2605-4ae0-8e12-1332c4d48911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.572692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836d5a-2605-4ae0-8e12-1332c4d48911 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.573465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836d5a-2605-4ae0-8e12-1332c4d48911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.575590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836d5a-2605-4ae0-8e12-1332c4d48911 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.698702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 976/1977] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:24 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:24.699779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb13459-af37-4346-be8a-1ba561d5c8bf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.700463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1002/1978] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:24 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:24.704786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836d5a-2605-4ae0-8e12-1332c4d48911 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.801505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836d5a-2605-4ae0-8e12-1332c4d48911 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.826279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61416e39-c254-403d-9067-15df9e0b3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.826279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61416e39-c254-403d-9067-15df9e0b3d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.826279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61416e39-c254-403d-9067-15df9e0b3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.826279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61416e39-c254-403d-9067-15df9e0b3d91 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.826811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61416e39-c254-403d-9067-15df9e0b3d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.828828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61416e39-c254-403d-9067-15df9e0b3d91 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.829948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb13459-af37-4346-be8a-1ba561d5c8bf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.838211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f63e8c-79e6-43f8-a540-4f70c75efe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.839016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63e8c-79e6-43f8-a540-4f70c75efe3a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.839296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63e8c-79e6-43f8-a540-4f70c75efe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.839642 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63e8c-79e6-43f8-a540-4f70c75efe3a admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.840350 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f63e8c-79e6-43f8-a540-4f70c75efe3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.842431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f63e8c-79e6-43f8-a540-4f70c75efe3a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.937970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1003/1979] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:24 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:24.942550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 977/1980] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:24 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:24.944960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61416e39-c254-403d-9067-15df9e0b3d91 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.945821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f63e8c-79e6-43f8-a540-4f70c75efe3a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.956508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61416e39-c254-403d-9067-15df9e0b3d91 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.960137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f63e8c-79e6-43f8-a540-4f70c75efe3a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:24.961721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e6b79-1348-4689-a3a9-e7347217dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.962490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e6b79-1348-4689-a3a9-e7347217dd41 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.962835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e6b79-1348-4689-a3a9-e7347217dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.963178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e6b79-1348-4689-a3a9-e7347217dd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.964086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e6b79-1348-4689-a3a9-e7347217dd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.966208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e6b79-1348-4689-a3a9-e7347217dd41 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.968695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679464de-ffc2-47a3-a2ce-2beb5a8cb295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:24.968915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:24.970111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679464de-ffc2-47a3-a2ce-2beb5a8cb295 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:24.970565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679464de-ffc2-47a3-a2ce-2beb5a8cb295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:24.971108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679464de-ffc2-47a3-a2ce-2beb5a8cb295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:24.971974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679464de-ffc2-47a3-a2ce-2beb5a8cb295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:24.974866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679464de-ffc2-47a3-a2ce-2beb5a8cb295 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:24.989303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1004/1981] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:24.990327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e6b79-1348-4689-a3a9-e7347217dd41 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:24.993865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 978/1982] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:24.995015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679464de-ffc2-47a3-a2ce-2beb5a8cb295 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.017634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e6b79-1348-4689-a3a9-e7347217dd41 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.018467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679464de-ffc2-47a3-a2ce-2beb5a8cb295 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.018602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b08275-24a1-499f-b660-84b57009c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.018602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b08275-24a1-499f-b660-84b57009c629 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.018602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b08275-24a1-499f-b660-84b57009c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.018602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b08275-24a1-499f-b660-84b57009c629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.018925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b08275-24a1-499f-b660-84b57009c629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.019020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacde5a-ceeb-4d94-bb2d-d83f2f2bf775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.019020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacde5a-ceeb-4d94-bb2d-d83f2f2bf775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.019020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacde5a-ceeb-4d94-bb2d-d83f2f2bf775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.019020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacde5a-ceeb-4d94-bb2d-d83f2f2bf775 admin admin] PATH_INFO: `/v3/projects/2967993645ab4c66add613c0c9b5b4fb/users/462aa8ddb5f4448ba1f1a836aaf436de/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.019336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b08275-24a1-499f-b660-84b57009c629 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.035427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacde5a-ceeb-4d94-bb2d-d83f2f2bf775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2967993645ab4c66add613c0c9b5b4fb, user_id=462aa8ddb5f4448ba1f1a836aaf436de, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.037931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacde5a-ceeb-4d94-bb2d-d83f2f2bf775 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.044061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1005/1983] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:25.048100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b08275-24a1-499f-b660-84b57009c629 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.066662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b08275-24a1-499f-b660-84b57009c629 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.072304 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58175e71-7af6-4ad2-9b05-d1649c3a1186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.073036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175e71-7af6-4ad2-9b05-d1649c3a1186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.073400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175e71-7af6-4ad2-9b05-d1649c3a1186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.073785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175e71-7af6-4ad2-9b05-d1649c3a1186 admin admin] PATH_INFO: `/v3/projects/650d8c4cc5124ac287aa3c3d210bfb59/users/591d27da9fe64d7a90042cf750360bc7/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.093529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58175e71-7af6-4ad2-9b05-d1649c3a1186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650d8c4cc5124ac287aa3c3d210bfb59, user_id=591d27da9fe64d7a90042cf750360bc7, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.097025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58175e71-7af6-4ad2-9b05-d1649c3a1186 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.115498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 979/1984] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:24 2022] PUT /identity/v3/projects/2967993645ab4c66add613c0c9b5b4fb/users/462aa8ddb5f4448ba1f1a836aaf436de/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:25.119314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacde5a-ceeb-4d94-bb2d-d83f2f2bf775 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.184667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacde5a-ceeb-4d94-bb2d-d83f2f2bf775 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.189508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48a39-095a-49e5-9f3f-853b7bde9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.190742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48a39-095a-49e5-9f3f-853b7bde9d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.191106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48a39-095a-49e5-9f3f-853b7bde9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.191461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe48a39-095a-49e5-9f3f-853b7bde9d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.192180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48a39-095a-49e5-9f3f-853b7bde9d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.193912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe48a39-095a-49e5-9f3f-853b7bde9d1e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.208495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 980/1985] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:25.209661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48a39-095a-49e5-9f3f-853b7bde9d1e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.212028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1006/1986] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:25 2022] PUT /identity/v3/projects/650d8c4cc5124ac287aa3c3d210bfb59/users/591d27da9fe64d7a90042cf750360bc7/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:25.227461 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20296304-a1ab-417c-a52f-69db1759af24 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.227971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20296304-a1ab-417c-a52f-69db1759af24 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.228255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20296304-a1ab-417c-a52f-69db1759af24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.235996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe48a39-095a-49e5-9f3f-853b7bde9d1e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.270053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-20296304-a1ab-417c-a52f-69db1759af24 None None] MFA Rules not processed for user `591d27da9fe64d7a90042cf750360bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:25.271452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-20296304-a1ab-417c-a52f-69db1759af24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:25.331463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2b6b2-e78f-4296-80d2-e734242ec977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.332830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b6b2-e78f-4296-80d2-e734242ec977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.332830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b6b2-e78f-4296-80d2-e734242ec977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.333245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2b6b2-e78f-4296-80d2-e734242ec977 admin admin] PATH_INFO: `/v3/projects/2967993645ab4c66add613c0c9b5b4fb/users/462aa8ddb5f4448ba1f1a836aaf436de/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.336631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2b6b2-e78f-4296-80d2-e734242ec977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2967993645ab4c66add613c0c9b5b4fb, user_id=462aa8ddb5f4448ba1f1a836aaf436de, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.340556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2b6b2-e78f-4296-80d2-e734242ec977 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.355917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 981/1987] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:25 2022] PUT /identity/v3/projects/2967993645ab4c66add613c0c9b5b4fb/users/462aa8ddb5f4448ba1f1a836aaf436de/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:25.369084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227974a2-86db-42c5-ba32-d3e50ae2a1cc None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.369545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227974a2-86db-42c5-ba32-d3e50ae2a1cc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.369963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227974a2-86db-42c5-ba32-d3e50ae2a1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.384098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1007/1988] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:25.385401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20296304-a1ab-417c-a52f-69db1759af24 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.410934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20296304-a1ab-417c-a52f-69db1759af24 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.414683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-227974a2-86db-42c5-ba32-d3e50ae2a1cc None None] MFA Rules not processed for user `462aa8ddb5f4448ba1f1a836aaf436de`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:25.416020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-227974a2-86db-42c5-ba32-d3e50ae2a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:25.495535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52bd64-1d54-412f-a6b4-f838908530ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.496117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52bd64-1d54-412f-a6b4-f838908530ad admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.496435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52bd64-1d54-412f-a6b4-f838908530ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.498183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52bd64-1d54-412f-a6b4-f838908530ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.498850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52bd64-1d54-412f-a6b4-f838908530ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.500814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52bd64-1d54-412f-a6b4-f838908530ad admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.508828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 982/1989] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:25.517424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227974a2-86db-42c5-ba32-d3e50ae2a1cc None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.518795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-227974a2-86db-42c5-ba32-d3e50ae2a1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:25.579978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227974a2-86db-42c5-ba32-d3e50ae2a1cc None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.584157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae76e-7a6b-4d45-a2ee-c0bce41b3f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.584775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae76e-7a6b-4d45-a2ee-c0bce41b3f7c service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.585229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae76e-7a6b-4d45-a2ee-c0bce41b3f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.585500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae76e-7a6b-4d45-a2ee-c0bce41b3f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.596930 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ae76e-7a6b-4d45-a2ee-c0bce41b3f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.598494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ae76e-7a6b-4d45-a2ee-c0bce41b3f7c service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.609645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 983/1990] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:25.619933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1008/1991] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:25 2022] POST /identity/v3/projects => generated 377 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:25.621339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae76e-7a6b-4d45-a2ee-c0bce41b3f7c service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.634128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae76e-7a6b-4d45-a2ee-c0bce41b3f7c service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.691952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aaee7-3418-4b70-85d2-3c417133b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.692493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aaee7-3418-4b70-85d2-3c417133b067 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.692779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aaee7-3418-4b70-85d2-3c417133b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.693058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aaee7-3418-4b70-85d2-3c417133b067 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.693720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17aaee7-3418-4b70-85d2-3c417133b067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.695663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17aaee7-3418-4b70-85d2-3c417133b067 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.793751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 984/1992] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:25 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:25.793872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52bd64-1d54-412f-a6b4-f838908530ad admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.798860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52bd64-1d54-412f-a6b4-f838908530ad admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.809005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d0f6-0a07-454c-9ac6-56970589f2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.809700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d0f6-0a07-454c-9ac6-56970589f2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.809942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d0f6-0a07-454c-9ac6-56970589f2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.810251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1d0f6-0a07-454c-9ac6-56970589f2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.811508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1d0f6-0a07-454c-9ac6-56970589f2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.813289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1d0f6-0a07-454c-9ac6-56970589f2c0 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.826105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1009/1993] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:25.830550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aaee7-3418-4b70-85d2-3c417133b067 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.840906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aaee7-3418-4b70-85d2-3c417133b067 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:25.845926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07019d-30f6-4d9a-bee4-c339a201b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:25.847111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07019d-30f6-4d9a-bee4-c339a201b305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:25.847394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07019d-30f6-4d9a-bee4-c339a201b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:25.847665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07019d-30f6-4d9a-bee4-c339a201b305 admin admin] PATH_INFO: `/v3/projects/fb3dc1cdb47a45e5aaba9e42b61403db/users/5a755f1fea514e1f88cb171cc150e896/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:25.863842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07019d-30f6-4d9a-bee4-c339a201b305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3dc1cdb47a45e5aaba9e42b61403db, user_id=5a755f1fea514e1f88cb171cc150e896, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:25.866855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07019d-30f6-4d9a-bee4-c339a201b305 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:25.951392 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 985/1994] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:25 2022] PUT /identity/v3/projects/fb3dc1cdb47a45e5aaba9e42b61403db/users/5a755f1fea514e1f88cb171cc150e896/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:25.955471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d0f6-0a07-454c-9ac6-56970589f2c0 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:25.966314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1d0f6-0a07-454c-9ac6-56970589f2c0 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:26.038337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03621a8a-bf54-476f-b8c7-10ddc4095f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:26.039504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621a8a-bf54-476f-b8c7-10ddc4095f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:26.039857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621a8a-bf54-476f-b8c7-10ddc4095f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:26.040325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03621a8a-bf54-476f-b8c7-10ddc4095f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:26.043275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03621a8a-bf54-476f-b8c7-10ddc4095f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:26.043561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03621a8a-bf54-476f-b8c7-10ddc4095f7b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:26.058565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1010/1995] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:26.061514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07019d-30f6-4d9a-bee4-c339a201b305 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:26.072968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07019d-30f6-4d9a-bee4-c339a201b305 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:26.081057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6ed7c-8371-4c2c-8210-5c6761ef8432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:26.081936 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6ed7c-8371-4c2c-8210-5c6761ef8432 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:26.082302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6ed7c-8371-4c2c-8210-5c6761ef8432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:26.082585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6ed7c-8371-4c2c-8210-5c6761ef8432 admin admin] PATH_INFO: `/v3/projects/fb3dc1cdb47a45e5aaba9e42b61403db/users/5a755f1fea514e1f88cb171cc150e896/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:26.084588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6ed7c-8371-4c2c-8210-5c6761ef8432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3dc1cdb47a45e5aaba9e42b61403db, user_id=5a755f1fea514e1f88cb171cc150e896, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:26.087311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6ed7c-8371-4c2c-8210-5c6761ef8432 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:26.097849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 986/1996] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:26 2022] PUT /identity/v3/projects/fb3dc1cdb47a45e5aaba9e42b61403db/users/5a755f1fea514e1f88cb171cc150e896/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:26.108142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba568f-6f6d-4530-9c0b-03761d018161 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:26.108432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba568f-6f6d-4530-9c0b-03761d018161 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:26.108705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba568f-6f6d-4530-9c0b-03761d018161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:26.137679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-0dba568f-6f6d-4530-9c0b-03761d018161 None None] MFA Rules not processed for user `5a755f1fea514e1f88cb171cc150e896`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:26.138885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0dba568f-6f6d-4530-9c0b-03761d018161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:26.154138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:26.217248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1011/1997] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:26.228770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6ed7c-8371-4c2c-8210-5c6761ef8432 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:26.286265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6ed7c-8371-4c2c-8210-5c6761ef8432 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:26.289865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72011e9d-3a4e-4594-b797-4eedaa2a060d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:26.290468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011e9d-3a4e-4594-b797-4eedaa2a060d service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:26.290749 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011e9d-3a4e-4594-b797-4eedaa2a060d service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:26.291026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72011e9d-3a4e-4594-b797-4eedaa2a060d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:26.351305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72011e9d-3a4e-4594-b797-4eedaa2a060d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:26.352798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72011e9d-3a4e-4594-b797-4eedaa2a060d service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:26.364698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 987/1998] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:26.536869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:27.045159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba568f-6f6d-4530-9c0b-03761d018161 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:27.076838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:27.125018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba568f-6f6d-4530-9c0b-03761d018161 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:27.130907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:27.131809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:27.132140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:27.132462 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] PATH_INFO: `/v3/users/70e458e99d4d4cc9b0cf726879e8d29f` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:27.133978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e458e99d4d4cc9b0cf726879e8d29f)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:27.135969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:27.398392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e458e99d4d4cc9b0cf726879e8d29f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.399686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e458e99d4d4cc9b0cf726879e8d29f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.399858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e458e99d4d4cc9b0cf726879e8d29f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.493209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e458e99d4d4cc9b0cf726879e8d29f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.506819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e458e99d4d4cc9b0cf726879e8d29f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.520519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1012/1999] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:27 2022] DELETE /identity/v3/users/70e458e99d4d4cc9b0cf726879e8d29f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:27.524952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16825170-0aef-43f1-84d0-4e838e913977 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:27.525406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16825170-0aef-43f1-84d0-4e838e913977 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:27.531649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16825170-0aef-43f1-84d0-4e838e913977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:27.543747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-16825170-0aef-43f1-84d0-4e838e913977 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:27.544924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-16825170-0aef-43f1-84d0-4e838e913977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:27.572144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:27.573784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:27.603431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 988/2000] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:27.617731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16825170-0aef-43f1-84d0-4e838e913977 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:27.628576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-16825170-0aef-43f1-84d0-4e838e913977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:27.640423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201947d0-859a-4d02-a808-8e4ef6339617 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:27.645271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:27.645932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:27.646228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:27.646505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] PATH_INFO: `/v3/users/5d96c1b010cc4fe884432b3f4d826eb5` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:27.647658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d96c1b010cc4fe884432b3f4d826eb5)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:27.649585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:27.676701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16825170-0aef-43f1-84d0-4e838e913977 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:27.680221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c391c-d9e7-46a3-91ff-d0ce1dc60c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:27.680826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c391c-d9e7-46a3-91ff-d0ce1dc60c47 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:27.681103 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c391c-d9e7-46a3-91ff-d0ce1dc60c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:27.681371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c391c-d9e7-46a3-91ff-d0ce1dc60c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:27.690708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c391c-d9e7-46a3-91ff-d0ce1dc60c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:27.692128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c391c-d9e7-46a3-91ff-d0ce1dc60c47 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:27.701245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 989/2001] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:27.851936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:27.896012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d96c1b010cc4fe884432b3f4d826eb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.896773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d96c1b010cc4fe884432b3f4d826eb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.897457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d96c1b010cc4fe884432b3f4d826eb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.965166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d96c1b010cc4fe884432b3f4d826eb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.980630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d96c1b010cc4fe884432b3f4d826eb5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:27.994321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:27.997960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1013/2002] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:27 2022] DELETE /identity/v3/users/5d96c1b010cc4fe884432b3f4d826eb5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:27.999687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405846-3790-4dc8-bec1-c705aaa6d4d3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:28.000023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405846-3790-4dc8-bec1-c705aaa6d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:28.000303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405846-3790-4dc8-bec1-c705aaa6d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:28.019451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-21405846-3790-4dc8-bec1-c705aaa6d4d3 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:28.020664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-21405846-3790-4dc8-bec1-c705aaa6d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:28.093896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 990/2003] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:28.103215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:28.105326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:28.183045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660dc01-4d0c-44db-995d-2a4037073a15 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:28.191192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:28.196684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:28.196684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:28.196684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:28.202366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:28.203833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:28.214688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1014/2004] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:28.261487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405846-3790-4dc8-bec1-c705aaa6d4d3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:28.264289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-21405846-3790-4dc8-bec1-c705aaa6d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:28.279857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405846-3790-4dc8-bec1-c705aaa6d4d3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:28.304358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:28.305453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:28.305813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:28.306061 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] PATH_INFO: `/v3/projects/1a123729cd66440793e93cbefe06ce17` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:28.307270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a123729cd66440793e93cbefe06ce17)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:28.309761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:28.337303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:28.475271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a123729cd66440793e93cbefe06ce17', 'request_id': 'req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:28.511600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:28.513953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:28.584516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e70a-e2ec-4cb2-9a16-ae6809887747 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:28.602365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a123729cd66440793e93cbefe06ce17', 'request_id': 'req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:28.619130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a123729cd66440793e93cbefe06ce17', 'request_id': 'req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:28.640116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] The token cache is being invalidate because project 1a123729cd66440793e93cbefe06ce17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:28.640422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:28.641434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:28.643231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 991/2005] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:28 2022] DELETE /identity/v3/projects/1a123729cd66440793e93cbefe06ce17 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:28.648010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:28.651522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:28.651760 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:28.652308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:28.652655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:28.652942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:28.655248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:28.729401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:28.730970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:28.743516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1015/2006] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:28.764662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:28.771199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57cace-e5fc-4ad8-8103-0eeefc3ebb9b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:28.781738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:28.782859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:28.783339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:28.784472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] PATH_INFO: `/v3/users/462aa8ddb5f4448ba1f1a836aaf436de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:28.786312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462aa8ddb5f4448ba1f1a836aaf436de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:28.788518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:28.880198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:29.047569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462aa8ddb5f4448ba1f1a836aaf436de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.057065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462aa8ddb5f4448ba1f1a836aaf436de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.057852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462aa8ddb5f4448ba1f1a836aaf436de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.059132 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462aa8ddb5f4448ba1f1a836aaf436de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.073594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462aa8ddb5f4448ba1f1a836aaf436de'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.197577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 992/2007] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:28 2022] DELETE /identity/v3/users/462aa8ddb5f4448ba1f1a836aaf436de => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:29.322948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:29.571634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:29.573134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:29.594239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:29.607647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec86d85-eb4c-4339-b7a2-ec3ebecb7789 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:29.697990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:29.699198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:29.699676 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:29.700145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] PATH_INFO: `/v3/projects/f68919e22b2c4893a4ceb1e047f8442f` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:29.701951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68919e22b2c4893a4ceb1e047f8442f)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:29.704791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:29.850128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68919e22b2c4893a4ceb1e047f8442f', 'request_id': 'req-7d17dc25-0b4b-4081-9917-167374b9c643'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.857865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68919e22b2c4893a4ceb1e047f8442f', 'request_id': 'req-7d17dc25-0b4b-4081-9917-167374b9c643'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.901516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:29.903448 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:29.919550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0e7c2-d089-47b6-954c-d03893b96da4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:29.948833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68919e22b2c4893a4ceb1e047f8442f', 'request_id': 'req-7d17dc25-0b4b-4081-9917-167374b9c643'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.962664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] The token cache is being invalidate because project f68919e22b2c4893a4ceb1e047f8442f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:29.963105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.963871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:29.965651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1016/2008] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:29 2022] DELETE /identity/v3/projects/f68919e22b2c4893a4ceb1e047f8442f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:29.970237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:29.972231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:29.985880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:29.986554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:29.986839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:29.987115 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] PATH_INFO: `/v3/projects/2967993645ab4c66add613c0c9b5b4fb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:29.988273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2967993645ab4c66add613c0c9b5b4fb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:29.990274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:30.041640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17dc25-0b4b-4081-9917-167374b9c643 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:30.046790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:30.047427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.047712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.048043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] PATH_INFO: `/v3/users/4fc77dbf2d604c37b524c5e5327e626f` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.049340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc77dbf2d604c37b524c5e5327e626f)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:30.051376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:30.133677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2967993645ab4c66add613c0c9b5b4fb', 'request_id': 'req-28ababaa-d204-4d4e-bdf6-353c3951b4e1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.213970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2967993645ab4c66add613c0c9b5b4fb', 'request_id': 'req-28ababaa-d204-4d4e-bdf6-353c3951b4e1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.221522 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2967993645ab4c66add613c0c9b5b4fb', 'request_id': 'req-28ababaa-d204-4d4e-bdf6-353c3951b4e1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.233220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] The token cache is being invalidate because project 2967993645ab4c66add613c0c9b5b4fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:30.235686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.235686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-28ababaa-d204-4d4e-bdf6-353c3951b4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.235893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 993/2009] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:29 2022] DELETE /identity/v3/projects/2967993645ab4c66add613c0c9b5b4fb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:30.241506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c1a6-8a80-44c5-bbb1-ab9c92fe4152 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.241818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c1a6-8a80-44c5-bbb1-ab9c92fe4152 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.242108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c1a6-8a80-44c5-bbb1-ab9c92fe4152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.268829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc77dbf2d604c37b524c5e5327e626f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.269525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc77dbf2d604c37b524c5e5327e626f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.270230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc77dbf2d604c37b524c5e5327e626f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.270661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4278c1a6-8a80-44c5-bbb1-ab9c92fe4152 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:30.272057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4278c1a6-8a80-44c5-bbb1-ab9c92fe4152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:30.340661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc77dbf2d604c37b524c5e5327e626f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.345130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 994/2010] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:30.352597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a93a6-c259-4817-9eff-cb421a7078ac None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.353074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a93a6-c259-4817-9eff-cb421a7078ac None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.353374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a93a6-c259-4817-9eff-cb421a7078ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.378330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc77dbf2d604c37b524c5e5327e626f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:30.395409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1017/2011] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:29 2022] DELETE /identity/v3/users/4fc77dbf2d604c37b524c5e5327e626f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:30.399501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c56a93a6-c259-4817-9eff-cb421a7078ac None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:30.400600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c56a93a6-c259-4817-9eff-cb421a7078ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:30.445211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:30.483704 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 995/2012] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:30.487996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:30.502960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2638b7b-356e-4229-8812-b57eaebf83d2 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:30.508260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:30.512113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.512113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.512113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.512113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:30.512113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:30.514528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:30.531144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1018/2013] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:30.533004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a93a6-c259-4817-9eff-cb421a7078ac None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:30.542543 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a93a6-c259-4817-9eff-cb421a7078ac None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:30.547406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2c667-8342-4117-a600-dc782c1f0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:30.548013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2c667-8342-4117-a600-dc782c1f0602 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.548291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2c667-8342-4117-a600-dc782c1f0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.548592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2c667-8342-4117-a600-dc782c1f0602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.550029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2c667-8342-4117-a600-dc782c1f0602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:30.552306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2c667-8342-4117-a600-dc782c1f0602 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:30.570347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:30.572260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:30.617159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:30.644196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02564c1-f7aa-481c-8c53-9a03830a0b14 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:30.647950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:30.648578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.648858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.649129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.650935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:30.658847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 996/2014] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:30 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:30.663530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2c667-8342-4117-a600-dc782c1f0602 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:30.766020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2c667-8342-4117-a600-dc782c1f0602 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:30.771135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89475a0-8101-4ba7-9f1e-64762007a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:30.781822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89475a0-8101-4ba7-9f1e-64762007a317 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.781822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89475a0-8101-4ba7-9f1e-64762007a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.781822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89475a0-8101-4ba7-9f1e-64762007a317 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.781822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89475a0-8101-4ba7-9f1e-64762007a317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:30.781822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89475a0-8101-4ba7-9f1e-64762007a317 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:30.782309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:30.782309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:30.789977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1019/2015] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:30.886079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 997/2016] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:30 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:30.902800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:30.912256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642adc7-27db-43cb-9804-cf7cc95afbea service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:30.936984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bda095-e55b-4be6-afa8-b3cefa081bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:30.937842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bda095-e55b-4be6-afa8-b3cefa081bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.938229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bda095-e55b-4be6-afa8-b3cefa081bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.938595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bda095-e55b-4be6-afa8-b3cefa081bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.939311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bda095-e55b-4be6-afa8-b3cefa081bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:30.941156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bda095-e55b-4be6-afa8-b3cefa081bb2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:30.952754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1020/2017] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:30.956482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89475a0-8101-4ba7-9f1e-64762007a317 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:30.981059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89475a0-8101-4ba7-9f1e-64762007a317 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:30.986111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:30.986801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:30.987086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:30.987367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:30.988043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:30.989733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:31.003334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 998/2018] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:31.065566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bda095-e55b-4be6-afa8-b3cefa081bb2 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:31.076230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bda095-e55b-4be6-afa8-b3cefa081bb2 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:31.081844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2e5eb-637d-405d-8b9d-616cc0ac3167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:31.085690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e5eb-637d-405d-8b9d-616cc0ac3167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.085979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e5eb-637d-405d-8b9d-616cc0ac3167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.086257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2e5eb-637d-405d-8b9d-616cc0ac3167 admin admin] PATH_INFO: `/v3/projects/e3df8f07e1ed4a8a8bf0f79402b5507d/users/f19466d44e854936a78a0decf79cc0a1/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.104912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2e5eb-637d-405d-8b9d-616cc0ac3167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3df8f07e1ed4a8a8bf0f79402b5507d, user_id=f19466d44e854936a78a0decf79cc0a1, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:31.105431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2e5eb-637d-405d-8b9d-616cc0ac3167 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:31.446949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1021/2019] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:31 2022] PUT /identity/v3/projects/e3df8f07e1ed4a8a8bf0f79402b5507d/users/f19466d44e854936a78a0decf79cc0a1/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:31.453211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:31.458304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:31.458481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a4a1-e346-4c60-8c39-13781a845d43 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.458593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a4a1-e346-4c60-8c39-13781a845d43 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.458929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8a4a1-e346-4c60-8c39-13781a845d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.473687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd192b3-1b31-4379-b318-ce9c42dfba6b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:31.494915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-54b8a4a1-e346-4c60-8c39-13781a845d43 None None] MFA Rules not processed for user `f19466d44e854936a78a0decf79cc0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:31.496155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-54b8a4a1-e346-4c60-8c39-13781a845d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:31.540834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:31.541527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.541837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.542108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] PATH_INFO: `/v3/projects/d8a8638ed14445d69a16a09375ab6139` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.543244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a8638ed14445d69a16a09375ab6139)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:31.545244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:31.575507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1022/2020] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:31.587745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8a4a1-e346-4c60-8c39-13781a845d43 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:31.589190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-54b8a4a1-e346-4c60-8c39-13781a845d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:31.597711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:31.655241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8a4a1-e346-4c60-8c39-13781a845d43 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:31.661450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a8638ed14445d69a16a09375ab6139', 'request_id': 'req-ff010f9a-6cc6-4971-87bc-4f9a09097247'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:31.704483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb938bf-8cd7-4f1e-bb24-fa57b004bb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:31.705105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb938bf-8cd7-4f1e-bb24-fa57b004bb26 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.705408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb938bf-8cd7-4f1e-bb24-fa57b004bb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.705721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb938bf-8cd7-4f1e-bb24-fa57b004bb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.750860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a8638ed14445d69a16a09375ab6139', 'request_id': 'req-ff010f9a-6cc6-4971-87bc-4f9a09097247'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:31.758268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a8638ed14445d69a16a09375ab6139', 'request_id': 'req-ff010f9a-6cc6-4971-87bc-4f9a09097247'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:31.765333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb938bf-8cd7-4f1e-bb24-fa57b004bb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:31.766917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb938bf-8cd7-4f1e-bb24-fa57b004bb26 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:31.769390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] The token cache is being invalidate because project d8a8638ed14445d69a16a09375ab6139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:31.769849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:31.770586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff010f9a-6cc6-4971-87bc-4f9a09097247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:31.772686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 999/2021] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:31 2022] DELETE /identity/v3/projects/d8a8638ed14445d69a16a09375ab6139 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:31.776540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1023/2022] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:31.776922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3de2-ac88-4cab-b08d-134658a1d4f2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.777391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3de2-ac88-4cab-b08d-134658a1d4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.778102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3de2-ac88-4cab-b08d-134658a1d4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.797281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb938bf-8cd7-4f1e-bb24-fa57b004bb26 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:31.799108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-466d3de2-ac88-4cab-b08d-134658a1d4f2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:31.800861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-466d3de2-ac88-4cab-b08d-134658a1d4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:31.863952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb938bf-8cd7-4f1e-bb24-fa57b004bb26 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:31.868301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1000/2023] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:31.869125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:31.869944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.870362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.870704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] PATH_INFO: `/v3/users/f19466d44e854936a78a0decf79cc0a1` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.872388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19466d44e854936a78a0decf79cc0a1)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:31.874486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:31.877487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37060b65-d8f1-42fc-9452-9bacef60f548 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.877896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37060b65-d8f1-42fc-9452-9bacef60f548 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.878243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37060b65-d8f1-42fc-9452-9bacef60f548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.898451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-37060b65-d8f1-42fc-9452-9bacef60f548 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:31.899782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-37060b65-d8f1-42fc-9452-9bacef60f548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:31.908127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1001/2024] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:31.912759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37060b65-d8f1-42fc-9452-9bacef60f548 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:31.921932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37060b65-d8f1-42fc-9452-9bacef60f548 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:31.928657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:31.928657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.928657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.928657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.929040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:31.929255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:31.930900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:31.942453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1002/2025] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:35:31.947146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:31.956987 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297b98-5ab3-4b16-9be9-4a1e44f03ac4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:31.962330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68979fb-38e0-43f1-a35d-28ef39758c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:31.962945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68979fb-38e0-43f1-a35d-28ef39758c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:31.963231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68979fb-38e0-43f1-a35d-28ef39758c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:31.963545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68979fb-38e0-43f1-a35d-28ef39758c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:31.964218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68979fb-38e0-43f1-a35d-28ef39758c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:31.966191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68979fb-38e0-43f1-a35d-28ef39758c86 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:32.088704 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1003/2026] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:31 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:32.100333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68979fb-38e0-43f1-a35d-28ef39758c86 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:32.128193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19466d44e854936a78a0decf79cc0a1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:32.128859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19466d44e854936a78a0decf79cc0a1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:32.129579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19466d44e854936a78a0decf79cc0a1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:32.189481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68979fb-38e0-43f1-a35d-28ef39758c86 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:32.197801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:32.198477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.198795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.199029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.199844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:32.201570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19466d44e854936a78a0decf79cc0a1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:32.217815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:32.218130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d34ad491-b1b6-42ed-b7c0-45260c22fc95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19466d44e854936a78a0decf79cc0a1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:32.230079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1024/2027] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:31 2022] DELETE /identity/v3/users/f19466d44e854936a78a0decf79cc0a1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:32.239152 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c97e6d-390c-4756-9d2f-4571e0c209fe None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.239559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c97e6d-390c-4756-9d2f-4571e0c209fe None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.239914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c97e6d-390c-4756-9d2f-4571e0c209fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.260494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-c1c97e6d-390c-4756-9d2f-4571e0c209fe None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:32.263774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c1c97e6d-390c-4756-9d2f-4571e0c209fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:32.289489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1004/2028] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:32 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:32.290464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:32.292198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:32.302015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:32.306744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bf8ad-1412-4541-8d22-af8be595bdd4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:32.325197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1025/2029] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:32.341069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c97e6d-390c-4756-9d2f-4571e0c209fe None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:32.342497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c1c97e6d-390c-4756-9d2f-4571e0c209fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:32.369957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517c599-148d-46d8-89e7-a406bd87d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:32.370585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517c599-148d-46d8-89e7-a406bd87d12a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.371041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517c599-148d-46d8-89e7-a406bd87d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.371329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517c599-148d-46d8-89e7-a406bd87d12a admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.371983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517c599-148d-46d8-89e7-a406bd87d12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:32.374041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517c599-148d-46d8-89e7-a406bd87d12a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:32.379906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:32.386274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1005/2030] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:32.390673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517c599-148d-46d8-89e7-a406bd87d12a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:32.400565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517c599-148d-46d8-89e7-a406bd87d12a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:32.405422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ce8f-c06b-4ef4-9bbd-7cef1952c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:32.412041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ce8f-c06b-4ef4-9bbd-7cef1952c408 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.412041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ce8f-c06b-4ef4-9bbd-7cef1952c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.412041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883ce8f-c06b-4ef4-9bbd-7cef1952c408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.412041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883ce8f-c06b-4ef4-9bbd-7cef1952c408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:32.412041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883ce8f-c06b-4ef4-9bbd-7cef1952c408 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:32.416847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c97e6d-390c-4756-9d2f-4571e0c209fe None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:32.420793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc0bde-35ff-4ee7-b2c5-5647b5506d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:32.421410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0bde-35ff-4ee7-b2c5-5647b5506d86 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.421726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0bde-35ff-4ee7-b2c5-5647b5506d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.422009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0bde-35ff-4ee7-b2c5-5647b5506d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.426354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1006/2031] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:32.427298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ce8f-c06b-4ef4-9bbd-7cef1952c408 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:32.436408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc0bde-35ff-4ee7-b2c5-5647b5506d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:32.438128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc0bde-35ff-4ee7-b2c5-5647b5506d86 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:32.439430 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883ce8f-c06b-4ef4-9bbd-7cef1952c408 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:32.449040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffd8b3-45fb-4cc5-93c7-2205f1a52410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:32.450416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffd8b3-45fb-4cc5-93c7-2205f1a52410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.453396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1026/2032] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:32.453950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffd8b3-45fb-4cc5-93c7-2205f1a52410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.454383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffd8b3-45fb-4cc5-93c7-2205f1a52410 admin admin] PATH_INFO: `/v3/projects/fb6cccefd1b24b7eaef129db4e131b6f/users/a2942ecc161749a0831be71b0666ce64/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.493737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffd8b3-45fb-4cc5-93c7-2205f1a52410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6cccefd1b24b7eaef129db4e131b6f, user_id=a2942ecc161749a0831be71b0666ce64, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:32.493737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffd8b3-45fb-4cc5-93c7-2205f1a52410 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:32.562472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1007/2033] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:32 2022] PUT /identity/v3/projects/fb6cccefd1b24b7eaef129db4e131b6f/users/a2942ecc161749a0831be71b0666ce64/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:32.565692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95329c9-d70b-4dab-91e4-61b8d2a9f7f5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.565924 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95329c9-d70b-4dab-91e4-61b8d2a9f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.566199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95329c9-d70b-4dab-91e4-61b8d2a9f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.594605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-a95329c9-d70b-4dab-91e4-61b8d2a9f7f5 None None] MFA Rules not processed for user `a2942ecc161749a0831be71b0666ce64`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:32.595858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a95329c9-d70b-4dab-91e4-61b8d2a9f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:32.661979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1027/2034] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:32.666779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffd8b3-45fb-4cc5-93c7-2205f1a52410 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:32.749915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffd8b3-45fb-4cc5-93c7-2205f1a52410 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:32.755146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:32.755757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.756061 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.756340 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.756988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:32.759052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:32.847143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1008/2035] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:32 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:32.848724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95329c9-d70b-4dab-91e4-61b8d2a9f7f5 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:32.860130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95329c9-d70b-4dab-91e4-61b8d2a9f7f5 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:32.890600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:32.895951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:32.926133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38476bbb-7455-4d1a-875f-40b22babe0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:32.926133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38476bbb-7455-4d1a-875f-40b22babe0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.926771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38476bbb-7455-4d1a-875f-40b22babe0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.926771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38476bbb-7455-4d1a-875f-40b22babe0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.929852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38476bbb-7455-4d1a-875f-40b22babe0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:32.929852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38476bbb-7455-4d1a-875f-40b22babe0c0 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:32.969741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f4e04-63bf-4c4f-a84d-eb10ae27edce admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:32.975049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:32.975742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:32.976026 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:32.976303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] PATH_INFO: `/v3/projects/e3df8f07e1ed4a8a8bf0f79402b5507d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:32.977488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3df8f07e1ed4a8a8bf0f79402b5507d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:32.979433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.046593 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1028/2036] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:32 2022] POST /identity/v3/users => generated 303 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:33.051341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38476bbb-7455-4d1a-875f-40b22babe0c0 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.061965 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38476bbb-7455-4d1a-875f-40b22babe0c0 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.067059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bffed-f9bc-4efd-9078-1e9f9b2843d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.067674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bffed-f9bc-4efd-9078-1e9f9b2843d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.067957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bffed-f9bc-4efd-9078-1e9f9b2843d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.068279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bffed-f9bc-4efd-9078-1e9f9b2843d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.068938 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bffed-f9bc-4efd-9078-1e9f9b2843d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.070587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bffed-f9bc-4efd-9078-1e9f9b2843d1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.083662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1029/2037] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:33.087585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bffed-f9bc-4efd-9078-1e9f9b2843d1 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.096721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3df8f07e1ed4a8a8bf0f79402b5507d', 'request_id': 'req-a1a47b97-a1ec-4041-b732-94d0ba64f62b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:33.098648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bffed-f9bc-4efd-9078-1e9f9b2843d1 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.157852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.159048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.159334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.159609 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] PATH_INFO: `/v3/projects/a2e0323721194ecb995075c81cdc212e/users/39518b1f099f4a66ae767127e8765680/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.173987 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3df8f07e1ed4a8a8bf0f79402b5507d', 'request_id': 'req-a1a47b97-a1ec-4041-b732-94d0ba64f62b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:33.174214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e0323721194ecb995075c81cdc212e, user_id=39518b1f099f4a66ae767127e8765680, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.177932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.181472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3df8f07e1ed4a8a8bf0f79402b5507d', 'request_id': 'req-a1a47b97-a1ec-4041-b732-94d0ba64f62b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:33.192089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] The token cache is being invalidate because project e3df8f07e1ed4a8a8bf0f79402b5507d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:33.192386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:33.193083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-a1a47b97-a1ec-4041-b732-94d0ba64f62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:33.194898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1009/2038] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:32 2022] DELETE /identity/v3/projects/e3df8f07e1ed4a8a8bf0f79402b5507d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:33.201080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230eef-8ba4-4f50-82f5-58332d7acf34 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.201374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230eef-8ba4-4f50-82f5-58332d7acf34 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.202115 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230eef-8ba4-4f50-82f5-58332d7acf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.224035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-27230eef-8ba4-4f50-82f5-58332d7acf34 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:33.225267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-27230eef-8ba4-4f50-82f5-58332d7acf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:33.233380 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1010/2039] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:33.241714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa8a7-20cb-48f5-bf12-8d47a4efb02e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.242006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa8a7-20cb-48f5-bf12-8d47a4efb02e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.242284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa8a7-20cb-48f5-bf12-8d47a4efb02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.261958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fbffa8a7-20cb-48f5-bf12-8d47a4efb02e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:33.263556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fbffa8a7-20cb-48f5-bf12-8d47a4efb02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:33.271793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1011/2040] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:33.276053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa8a7-20cb-48f5-bf12-8d47a4efb02e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.286118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa8a7-20cb-48f5-bf12-8d47a4efb02e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.292124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.292753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.293036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.293310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.294002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:33.294338 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.295993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.305858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:33.312248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1030/2041] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:33 2022] PUT /identity/v3/projects/a2e0323721194ecb995075c81cdc212e/users/39518b1f099f4a66ae767127e8765680/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:33.312406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1012/2042] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:35:33.318443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.319549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.320671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:33.330809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b007e-02b6-4deb-ad79-6d23d22771eb admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.359870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:33.389138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d39d2b-4b22-43bf-a4b7-5371787759bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.389800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39d2b-4b22-43bf-a4b7-5371787759bf admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.390091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39d2b-4b22-43bf-a4b7-5371787759bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.390365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d39d2b-4b22-43bf-a4b7-5371787759bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.390600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc4cb0-ce4a-41e7-b69c-bdeab8d3554b admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.391001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d39d2b-4b22-43bf-a4b7-5371787759bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.392937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d39d2b-4b22-43bf-a4b7-5371787759bf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.395409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaa6ea-09e8-4cde-a40f-0b0285b9fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.396007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaa6ea-09e8-4cde-a40f-0b0285b9fdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.397826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaa6ea-09e8-4cde-a40f-0b0285b9fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.397826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaa6ea-09e8-4cde-a40f-0b0285b9fdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.397826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaa6ea-09e8-4cde-a40f-0b0285b9fdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.399047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaa6ea-09e8-4cde-a40f-0b0285b9fdf2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.410089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1031/2043] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:33.414154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaa6ea-09e8-4cde-a40f-0b0285b9fdf2 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.424184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaa6ea-09e8-4cde-a40f-0b0285b9fdf2 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.429590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178625d-21bd-494d-99fc-5ca34dcd8712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.430209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178625d-21bd-494d-99fc-5ca34dcd8712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.430493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178625d-21bd-494d-99fc-5ca34dcd8712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.430774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178625d-21bd-494d-99fc-5ca34dcd8712 admin admin] PATH_INFO: `/v3/projects/a2e0323721194ecb995075c81cdc212e/users/39518b1f099f4a66ae767127e8765680/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.432888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178625d-21bd-494d-99fc-5ca34dcd8712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e0323721194ecb995075c81cdc212e, user_id=39518b1f099f4a66ae767127e8765680, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.435620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178625d-21bd-494d-99fc-5ca34dcd8712 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.446168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1032/2044] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:33 2022] PUT /identity/v3/projects/a2e0323721194ecb995075c81cdc212e/users/39518b1f099f4a66ae767127e8765680/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:33.456258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c185-bcee-4cdb-9090-b6cde379b74a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.456551 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c185-bcee-4cdb-9090-b6cde379b74a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.456832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c185-bcee-4cdb-9090-b6cde379b74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.485385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-fd29c185-bcee-4cdb-9090-b6cde379b74a None None] MFA Rules not processed for user `39518b1f099f4a66ae767127e8765680`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:33.487253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fd29c185-bcee-4cdb-9090-b6cde379b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:33.524173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1013/2045] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:33 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:33.525112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d39d2b-4b22-43bf-a4b7-5371787759bf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.583540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1033/2046] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:33.598126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29c185-bcee-4cdb-9090-b6cde379b74a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.599567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fd29c185-bcee-4cdb-9090-b6cde379b74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:33.604869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d39d2b-4b22-43bf-a4b7-5371787759bf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.610555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477064d-5e7e-4384-b118-1eba3870c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.616602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477064d-5e7e-4384-b118-1eba3870c361 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.616602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477064d-5e7e-4384-b118-1eba3870c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.616602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477064d-5e7e-4384-b118-1eba3870c361 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.616602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477064d-5e7e-4384-b118-1eba3870c361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.616602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477064d-5e7e-4384-b118-1eba3870c361 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.663495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29c185-bcee-4cdb-9090-b6cde379b74a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.703071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1014/2047] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:33 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:33.707173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477064d-5e7e-4384-b118-1eba3870c361 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.717259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477064d-5e7e-4384-b118-1eba3870c361 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.722796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.722977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b268bc-dbed-4f00-8242-22fe61a16844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.723089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.723089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.723276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.723553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b268bc-dbed-4f00-8242-22fe61a16844 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.723955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b268bc-dbed-4f00-8242-22fe61a16844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.724300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b268bc-dbed-4f00-8242-22fe61a16844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.725019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b268bc-dbed-4f00-8242-22fe61a16844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.726731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b268bc-dbed-4f00-8242-22fe61a16844 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.738234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1015/2048] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:33.742673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b268bc-dbed-4f00-8242-22fe61a16844 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.753517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b268bc-dbed-4f00-8242-22fe61a16844 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.759090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7c00-73e2-4f4b-83f6-8c2bd4f6ac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.759699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7c00-73e2-4f4b-83f6-8c2bd4f6ac81 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.759986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7c00-73e2-4f4b-83f6-8c2bd4f6ac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.760263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7c00-73e2-4f4b-83f6-8c2bd4f6ac81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.760942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c7c00-73e2-4f4b-83f6-8c2bd4f6ac81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.762895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c7c00-73e2-4f4b-83f6-8c2bd4f6ac81 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.777051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1016/2049] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:33.781323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7c00-73e2-4f4b-83f6-8c2bd4f6ac81 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.787352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.788848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.792061 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7c00-73e2-4f4b-83f6-8c2bd4f6ac81 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.797257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e23c2d-ce72-41d7-987b-e5c3c4b438a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.798030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e23c2d-ce72-41d7-987b-e5c3c4b438a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.798389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e23c2d-ce72-41d7-987b-e5c3c4b438a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.798816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1034/2050] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:33.798955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e23c2d-ce72-41d7-987b-e5c3c4b438a4 admin admin] PATH_INFO: `/v3/projects/9c41c6b3bba54a2cbeb3b5f6c03814bf/users/afe0630455504dee8c7ab7ccc464c3fb/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.821158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e23c2d-ce72-41d7-987b-e5c3c4b438a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c41c6b3bba54a2cbeb3b5f6c03814bf, user_id=afe0630455504dee8c7ab7ccc464c3fb, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.823958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e23c2d-ce72-41d7-987b-e5c3c4b438a4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.851454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:33.852996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:33.865206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6ef32-eed0-42b6-8f28-5b3c21eb77e3 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:33.869032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:33.869688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.869966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.870244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.872028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:33.898746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1017/2051] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:33 2022] PUT /identity/v3/projects/9c41c6b3bba54a2cbeb3b5f6c03814bf/users/afe0630455504dee8c7ab7ccc464c3fb/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:33.909413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79ad89-8a54-43d3-8ae1-d566ddeea844 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:33.909864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79ad89-8a54-43d3-8ae1-d566ddeea844 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:33.910229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79ad89-8a54-43d3-8ae1-d566ddeea844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:33.943824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8d79ad89-8a54-43d3-8ae1-d566ddeea844 None None] MFA Rules not processed for user `afe0630455504dee8c7ab7ccc464c3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:33.945049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8d79ad89-8a54-43d3-8ae1-d566ddeea844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:33.948793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:33.950875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:33.963417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1035/2052] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:34.021662 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1018/2053] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:34.038424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:34.038560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:34.046344 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b93d1-8c4a-4e79-883c-4c6f4592dab8 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:34.107206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353002c6-7709-44ba-be23-3de9d259dbf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:34.107920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353002c6-7709-44ba-be23-3de9d259dbf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:34.108279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353002c6-7709-44ba-be23-3de9d259dbf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:34.108637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353002c6-7709-44ba-be23-3de9d259dbf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:34.118787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353002c6-7709-44ba-be23-3de9d259dbf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:34.120227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353002c6-7709-44ba-be23-3de9d259dbf8 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:34.129918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1036/2054] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:34.155996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79ad89-8a54-43d3-8ae1-d566ddeea844 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:34.228872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79ad89-8a54-43d3-8ae1-d566ddeea844 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:34.233884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:34.234523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:34.234804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:34.235079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] PATH_INFO: `/v3/users/afe0630455504dee8c7ab7ccc464c3fb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:34.236245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe0630455504dee8c7ab7ccc464c3fb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:34.238236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:34.473497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe0630455504dee8c7ab7ccc464c3fb'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:34.484046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe0630455504dee8c7ab7ccc464c3fb'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:34.484335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:34.489237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe0630455504dee8c7ab7ccc464c3fb'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:34.489237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe0630455504dee8c7ab7ccc464c3fb'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:34.502608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe0630455504dee8c7ab7ccc464c3fb'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:34.575665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1019/2055] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:34 2022] DELETE /identity/v3/users/afe0630455504dee8c7ab7ccc464c3fb => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:34.582579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc18d-9721-42f4-8e67-e32f3ee7f3c9 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:34.582579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc18d-9721-42f4-8e67-e32f3ee7f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:34.582809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fc18d-9721-42f4-8e67-e32f3ee7f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:34.605146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-720fc18d-9721-42f4-8e67-e32f3ee7f3c9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:34.606459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-720fc18d-9721-42f4-8e67-e32f3ee7f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:34.680989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1037/2056] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:34.694101 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:34.696435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:34.704432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:34.781302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cb141-5ad3-4435-ae46-4a37dc1a7831 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:34.785678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11213f21-e52d-405f-9808-ecaecc4487d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:34.787687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11213f21-e52d-405f-9808-ecaecc4487d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:34.787687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11213f21-e52d-405f-9808-ecaecc4487d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:34.787687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11213f21-e52d-405f-9808-ecaecc4487d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:34.796410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11213f21-e52d-405f-9808-ecaecc4487d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:34.798013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11213f21-e52d-405f-9808-ecaecc4487d6 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:34.808454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1020/2057] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:35.255847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fc18d-9721-42f4-8e67-e32f3ee7f3c9 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:35.257288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-720fc18d-9721-42f4-8e67-e32f3ee7f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:35.270175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fc18d-9721-42f4-8e67-e32f3ee7f3c9 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:35.275594 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:35.276292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:35.276551 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:35.276832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] PATH_INFO: `/v3/projects/9c41c6b3bba54a2cbeb3b5f6c03814bf` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:35.278184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c41c6b3bba54a2cbeb3b5f6c03814bf)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:35.280130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:35.405284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c41c6b3bba54a2cbeb3b5f6c03814bf', 'request_id': 'req-1408342a-be16-4363-9a87-8706cfe401ea'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:35.414263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c41c6b3bba54a2cbeb3b5f6c03814bf', 'request_id': 'req-1408342a-be16-4363-9a87-8706cfe401ea'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:35.459797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:35.482588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c41c6b3bba54a2cbeb3b5f6c03814bf', 'request_id': 'req-1408342a-be16-4363-9a87-8706cfe401ea'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:35.495191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] The token cache is being invalidate because project 9c41c6b3bba54a2cbeb3b5f6c03814bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:35.495486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:35.496147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1408342a-be16-4363-9a87-8706cfe401ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:35.497678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1038/2058] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:35 2022] DELETE /identity/v3/projects/9c41c6b3bba54a2cbeb3b5f6c03814bf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:35.502739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b737-6d2a-4fbb-bdb6-134af04ee894 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:35.502989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b737-6d2a-4fbb-bdb6-134af04ee894 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:35.503311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b737-6d2a-4fbb-bdb6-134af04ee894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:35.505303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:35.548311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4b69b737-6d2a-4fbb-bdb6-134af04ee894 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:35.550509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4b69b737-6d2a-4fbb-bdb6-134af04ee894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:35.627114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1021/2059] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:35.636000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c4e6f-79d2-4139-a22c-e242e4ecf7f7 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:35.636508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c4e6f-79d2-4139-a22c-e242e4ecf7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:35.636608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c4e6f-79d2-4139-a22c-e242e4ecf7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:35.656700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-0b7c4e6f-79d2-4139-a22c-e242e4ecf7f7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:35.657986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0b7c4e6f-79d2-4139-a22c-e242e4ecf7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:35.666630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1039/2060] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:35.671202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b737-6d2a-4fbb-bdb6-134af04ee894 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:35.685596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b737-6d2a-4fbb-bdb6-134af04ee894 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:35.691927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:35.692950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:35.693535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:35.694610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:35.699448 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:35.699827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:35.710619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:35.716202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:35.731315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1022/2061] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:35.732638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c4e6f-79d2-4139-a22c-e242e4ecf7f7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:35.743428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c4e6f-79d2-4139-a22c-e242e4ecf7f7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:35.749127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:35.753942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:35.753942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:35.753942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:35.753942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:35.753942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:35.902730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1040/2062] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:35 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:35.909653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:35.928343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c5c7e-a9ff-429d-9840-1c3617507875 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:36.006109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d4f7e-8942-48b6-8389-b3bd9be3f39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:36.006952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4f7e-8942-48b6-8389-b3bd9be3f39d admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.008064 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4f7e-8942-48b6-8389-b3bd9be3f39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.008484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d4f7e-8942-48b6-8389-b3bd9be3f39d admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.009320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d4f7e-8942-48b6-8389-b3bd9be3f39d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:36.011593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d4f7e-8942-48b6-8389-b3bd9be3f39d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:36.081983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:36.083847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:36.104387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf163-373b-4a8e-9753-4a1ee67b7ffe admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:36.109949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:36.110103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.110376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.110708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] PATH_INFO: `/v3/users/e46133953e354d568dbeb98119d4416f` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.112420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46133953e354d568dbeb98119d4416f)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:36.114404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:36.176524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1023/2063] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:35 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:36.180743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d4f7e-8942-48b6-8389-b3bd9be3f39d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:36.190551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d4f7e-8942-48b6-8389-b3bd9be3f39d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:36.195357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51effa6e-64ba-4535-8a03-d9f130b6ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:36.195979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51effa6e-64ba-4535-8a03-d9f130b6ab03 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.196288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51effa6e-64ba-4535-8a03-d9f130b6ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.196588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51effa6e-64ba-4535-8a03-d9f130b6ab03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.197237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51effa6e-64ba-4535-8a03-d9f130b6ab03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:36.198909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51effa6e-64ba-4535-8a03-d9f130b6ab03 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:36.210073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1024/2064] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:36.214229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51effa6e-64ba-4535-8a03-d9f130b6ab03 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:36.224584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51effa6e-64ba-4535-8a03-d9f130b6ab03 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:36.229980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b19e0e-678f-482e-a218-077549d8e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:36.230883 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19e0e-678f-482e-a218-077549d8e759 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.231167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19e0e-678f-482e-a218-077549d8e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.231463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19e0e-678f-482e-a218-077549d8e759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.232110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b19e0e-678f-482e-a218-077549d8e759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:36.233791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b19e0e-678f-482e-a218-077549d8e759 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:36.246362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1025/2065] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:36.249382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b19e0e-678f-482e-a218-077549d8e759 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:36.265190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b19e0e-678f-482e-a218-077549d8e759 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:36.266133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59f9d7-506a-480e-a585-35abeb5b956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:36.266797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f9d7-506a-480e-a585-35abeb5b956b admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.267090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f9d7-506a-480e-a585-35abeb5b956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.267428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59f9d7-506a-480e-a585-35abeb5b956b admin admin] PATH_INFO: `/v3/projects/32a83af0151b48a5a1428996ca0b58b5/users/148ab9508da34daba05ef09292d92a92/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.289400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59f9d7-506a-480e-a585-35abeb5b956b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a83af0151b48a5a1428996ca0b58b5, user_id=148ab9508da34daba05ef09292d92a92, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:36.292172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59f9d7-506a-480e-a585-35abeb5b956b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:36.327829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46133953e354d568dbeb98119d4416f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:36.328490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46133953e354d568dbeb98119d4416f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:36.329109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46133953e354d568dbeb98119d4416f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:36.389200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1026/2066] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:36 2022] PUT /identity/v3/projects/32a83af0151b48a5a1428996ca0b58b5/users/148ab9508da34daba05ef09292d92a92/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:36.394882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28307f2-bfa6-400c-9577-0de619d8960b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.395240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28307f2-bfa6-400c-9577-0de619d8960b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.395598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28307f2-bfa6-400c-9577-0de619d8960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.419700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46133953e354d568dbeb98119d4416f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:36.431281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d28307f2-bfa6-400c-9577-0de619d8960b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:36.431281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d28307f2-bfa6-400c-9577-0de619d8960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:36.437657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-d70de789-b9aa-4ecb-8c71-7588d3338aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46133953e354d568dbeb98119d4416f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:36.453678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1041/2067] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:36 2022] DELETE /identity/v3/users/e46133953e354d568dbeb98119d4416f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:36.459040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9cb5-8e30-40ae-91b8-6e644c24f95a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.465005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9cb5-8e30-40ae-91b8-6e644c24f95a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.465005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c9cb5-8e30-40ae-91b8-6e644c24f95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.485187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-342c9cb5-8e30-40ae-91b8-6e644c24f95a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:36.486446 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-342c9cb5-8e30-40ae-91b8-6e644c24f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:36.532953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1027/2068] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:36.542808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28307f2-bfa6-400c-9577-0de619d8960b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:36.546918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d28307f2-bfa6-400c-9577-0de619d8960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:36.576563 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1042/2069] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:36.589413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9cb5-8e30-40ae-91b8-6e644c24f95a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:36.596897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-342c9cb5-8e30-40ae-91b8-6e644c24f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:36.639768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28307f2-bfa6-400c-9577-0de619d8960b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:36.674745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c9cb5-8e30-40ae-91b8-6e644c24f95a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:36.680644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:36.681438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.681758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.682037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.695808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:36.697375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:36.705917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:36.710441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1043/2070] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:36.728184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075771-c55f-4653-83a9-ba6eb401ea4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:36.729357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075771-c55f-4653-83a9-ba6eb401ea4a service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:36.729656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075771-c55f-4653-83a9-ba6eb401ea4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:36.729951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075771-c55f-4653-83a9-ba6eb401ea4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:36.746732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58075771-c55f-4653-83a9-ba6eb401ea4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:36.748258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58075771-c55f-4653-83a9-ba6eb401ea4a service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:36.762498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1028/2071] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:35:36.877163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:37.234925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:37.237354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:37.256205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1293a-533d-49f2-b474-5e11a9dff178 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:37.271834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:37.285753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:37.286465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:37.286935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] PATH_INFO: `/v3/projects/f889692530994202a841f5e9b5d3f37a` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:37.288812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f889692530994202a841f5e9b5d3f37a)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:37.292299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:37.511702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f889692530994202a841f5e9b5d3f37a', 'request_id': 'req-7cd52bd3-9aea-407d-97fd-86822f36cbf6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:37.541121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f889692530994202a841f5e9b5d3f37a', 'request_id': 'req-7cd52bd3-9aea-407d-97fd-86822f36cbf6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:37.663105 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f889692530994202a841f5e9b5d3f37a', 'request_id': 'req-7cd52bd3-9aea-407d-97fd-86822f36cbf6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:37.681205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] The token cache is being invalidate because project f889692530994202a841f5e9b5d3f37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:37.682531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:37.683437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7cd52bd3-9aea-407d-97fd-86822f36cbf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:37.687279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1044/2072] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:37 2022] DELETE /identity/v3/projects/f889692530994202a841f5e9b5d3f37a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:37.691971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075771-c55f-4653-83a9-ba6eb401ea4a service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:37.708194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075771-c55f-4653-83a9-ba6eb401ea4a service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:37.783287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:37.784366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:37.784808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:37.785325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] PATH_INFO: `/v3/users/591d27da9fe64d7a90042cf750360bc7` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:37.790782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=591d27da9fe64d7a90042cf750360bc7)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:37.790782 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:38.078720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591d27da9fe64d7a90042cf750360bc7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.085695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591d27da9fe64d7a90042cf750360bc7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.090193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591d27da9fe64d7a90042cf750360bc7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.090193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591d27da9fe64d7a90042cf750360bc7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.099857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591d27da9fe64d7a90042cf750360bc7'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.206249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f912e2-d3d5-4c2a-8f84-f2dcf6728ee8 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:38.206546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f912e2-d3d5-4c2a-8f84-f2dcf6728ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:38.206881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f912e2-d3d5-4c2a-8f84-f2dcf6728ee8 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:38.208239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1045/2073] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:35:38.219834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9aaaf-8519-4fd4-999c-3dd017621eb4 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:38.220185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9aaaf-8519-4fd4-999c-3dd017621eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:38.220491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9aaaf-8519-4fd4-999c-3dd017621eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:38.225721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1029/2074] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:37 2022] DELETE /identity/v3/users/591d27da9fe64d7a90042cf750360bc7 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:38.241452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:38.254584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-02a9aaaf-8519-4fd4-999c-3dd017621eb4 None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:38.255900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-02a9aaaf-8519-4fd4-999c-3dd017621eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:38.338990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1046/2075] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:38.350888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:38.352322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:38.367713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999920a-99f1-420b-ba15-72d72d84c360 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:38.372745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:38.373364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:38.373919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:38.374094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:38.394351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9aaaf-8519-4fd4-999c-3dd017621eb4 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:38.396605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:38.396933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-02a9aaaf-8519-4fd4-999c-3dd017621eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:38.398740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:38.407053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:38.416976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1030/2076] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:38.489691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9aaaf-8519-4fd4-999c-3dd017621eb4 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:38.495310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:38.495967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:38.496250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:38.496520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] PATH_INFO: `/v3/users/98c81b8a6a7b4c5ab328d9095ef5b1d1` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:38.497942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c81b8a6a7b4c5ab328d9095ef5b1d1)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:38.499883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:38.725122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c81b8a6a7b4c5ab328d9095ef5b1d1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.725864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c81b8a6a7b4c5ab328d9095ef5b1d1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.726393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c81b8a6a7b4c5ab328d9095ef5b1d1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.746461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:38.748792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:38.770741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9f5b-2576-4993-af9b-1936e32cffff service placement] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:38.776784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:38.785028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:38.785028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:38.785028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] PATH_INFO: `/v3/projects/650d8c4cc5124ac287aa3c3d210bfb59` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:38.785028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=650d8c4cc5124ac287aa3c3d210bfb59)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:38.785028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:38.800394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c81b8a6a7b4c5ab328d9095ef5b1d1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.820786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-75496cf3-7016-49a0-ab7a-ca9abecdc899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c81b8a6a7b4c5ab328d9095ef5b1d1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.834237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1047/2077] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:38 2022] DELETE /identity/v3/users/98c81b8a6a7b4c5ab328d9095ef5b1d1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:38.845411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d69b-8a76-46e9-b874-c956b3f6cf44 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:38.845730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d69b-8a76-46e9-b874-c956b3f6cf44 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:38.846119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d69b-8a76-46e9-b874-c956b3f6cf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:38.887588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-3695d69b-8a76-46e9-b874-c956b3f6cf44 None None] MFA Rules not processed for user `148ab9508da34daba05ef09292d92a92`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:38.894261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3695d69b-8a76-46e9-b874-c956b3f6cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:38.950248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650d8c4cc5124ac287aa3c3d210bfb59', 'request_id': 'req-f46c650b-21c9-4f46-9779-b8c3cbd41cac'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:38.999881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1048/2078] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:39.011558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d69b-8a76-46e9-b874-c956b3f6cf44 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:39.013385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3695d69b-8a76-46e9-b874-c956b3f6cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.023617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650d8c4cc5124ac287aa3c3d210bfb59', 'request_id': 'req-f46c650b-21c9-4f46-9779-b8c3cbd41cac'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.033850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650d8c4cc5124ac287aa3c3d210bfb59', 'request_id': 'req-f46c650b-21c9-4f46-9779-b8c3cbd41cac'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.051906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] The token cache is being invalidate because project 650d8c4cc5124ac287aa3c3d210bfb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:39.053687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.054657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.058084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1031/2079] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:38 2022] DELETE /identity/v3/projects/650d8c4cc5124ac287aa3c3d210bfb59 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:39.063174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:39.067007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.091505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d69b-8a76-46e9-b874-c956b3f6cf44 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:39.143007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c650b-21c9-4f46-9779-b8c3cbd41cac admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:39.148131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:39.151902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.151902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.151902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] PATH_INFO: `/v3/users/5a755f1fea514e1f88cb171cc150e896` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.151902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a755f1fea514e1f88cb171cc150e896)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:39.152650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:39.155674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:39.156464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.156825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.157198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.160084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.226353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:39.227955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:39.238000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1049/2080] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:39.240660 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:39.243896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.255934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c398c-9606-42e0-8c2b-c7c7b1e47414 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:39.265396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:39.265396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.265396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.265396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] PATH_INFO: `/v3/projects/ccf8670883ee40d8b08788c6e2f1a7d0` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.269021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf8670883ee40d8b08788c6e2f1a7d0)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:39.271161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:39.377162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a755f1fea514e1f88cb171cc150e896'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.385898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a755f1fea514e1f88cb171cc150e896'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.386665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a755f1fea514e1f88cb171cc150e896'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.387287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a755f1fea514e1f88cb171cc150e896'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.400329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a755f1fea514e1f88cb171cc150e896'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.405163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf8670883ee40d8b08788c6e2f1a7d0', 'request_id': 'req-686e316e-4193-4b5f-b564-a3227d618a65'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.412549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf8670883ee40d8b08788c6e2f1a7d0', 'request_id': 'req-686e316e-4193-4b5f-b564-a3227d618a65'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.459834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1032/2081] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:39 2022] DELETE /identity/v3/users/5a755f1fea514e1f88cb171cc150e896 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:39.460821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:39.462424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.534833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf8670883ee40d8b08788c6e2f1a7d0', 'request_id': 'req-686e316e-4193-4b5f-b564-a3227d618a65'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.548257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] The token cache is being invalidate because project ccf8670883ee40d8b08788c6e2f1a7d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:39.548667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.549592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-686e316e-4193-4b5f-b564-a3227d618a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.550054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b9dd2-f2f2-4340-83aa-9a74248ccd2c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:39.551822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1050/2082] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:39 2022] DELETE /identity/v3/projects/ccf8670883ee40d8b08788c6e2f1a7d0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:39.556066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:39.556619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.556981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.557325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] PATH_INFO: `/v3/users/a2942ecc161749a0831be71b0666ce64` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.557647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63906cc-c477-49f7-a49a-cd197176ad8f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.558038 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63906cc-c477-49f7-a49a-cd197176ad8f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.558345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63906cc-c477-49f7-a49a-cd197176ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.558790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2942ecc161749a0831be71b0666ce64)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:39.560969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:39.589466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f63906cc-c477-49f7-a49a-cd197176ad8f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:39.590809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f63906cc-c477-49f7-a49a-cd197176ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.599522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1051/2083] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:39.608805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b432-042c-4387-843c-90ffd54250a3 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.609090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b432-042c-4387-843c-90ffd54250a3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.609356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b432-042c-4387-843c-90ffd54250a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.628090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:39.631911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e677b432-042c-4387-843c-90ffd54250a3 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:39.633104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e677b432-042c-4387-843c-90ffd54250a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.642652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1052/2084] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:39.647279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677b432-042c-4387-843c-90ffd54250a3 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:39.657768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677b432-042c-4387-843c-90ffd54250a3 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:39.663192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:39.664389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.664389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.664389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.665020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:39.665323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:39.667030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:39.678809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1053/2085] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:35:39.683388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:39.698405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb0a11-6005-4e69-8867-b7e9e09b5398 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:39.703598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:39.704203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.705015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.705297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.706566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:39.709525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:39.780882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2942ecc161749a0831be71b0666ce64'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.790228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2942ecc161749a0831be71b0666ce64'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.790982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2942ecc161749a0831be71b0666ce64'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.791954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2942ecc161749a0831be71b0666ce64'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.810385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1054/2086] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:39 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:39.814710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:39.817694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.824004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0b2f3f84-87b7-4d47-93fc-9dd0e04fa978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2942ecc161749a0831be71b0666ce64'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:39.888471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28c2bd-bc71-43b1-8ee3-83d1ca9067a7 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:39.893937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:39.894666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.894972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.895236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.895868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:39.898184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:39.951460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1033/2087] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:39 2022] DELETE /identity/v3/users/a2942ecc161749a0831be71b0666ce64 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:39.956317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d722aa7-f306-4bf3-9faa-9a8751fa2ffa None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:39.956605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d722aa7-f306-4bf3-9faa-9a8751fa2ffa None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:39.956881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d722aa7-f306-4bf3-9faa-9a8751fa2ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:39.980459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5d722aa7-f306-4bf3-9faa-9a8751fa2ffa None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:39.981992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5d722aa7-f306-4bf3-9faa-9a8751fa2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:39.983557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1055/2088] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:39 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:39.984859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:39.987123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:40.021169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72791-2838-4da6-b76d-6c0a6c74eb12 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:40.061298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1034/2089] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:40.062299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d722aa7-f306-4bf3-9faa-9a8751fa2ffa None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:40.073458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d722aa7-f306-4bf3-9faa-9a8751fa2ffa None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:40.075345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:40.076144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:40.076432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:40.076704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] PATH_INFO: `/v3/projects/fb3dc1cdb47a45e5aaba9e42b61403db` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:40.078688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3dc1cdb47a45e5aaba9e42b61403db)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:40.079142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:40.079944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:40.080776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:40.081070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:40.081349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:40.082065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:40.083657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:40.094315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1035/2090] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:40.097573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:40.099283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:40.157317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccdc22-9a4c-4069-9a4d-df8c09588d45 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:40.161242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91e4a-94db-4258-b7f6-4e5ff968465b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:40.161820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91e4a-94db-4258-b7f6-4e5ff968465b service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:40.162190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91e4a-94db-4258-b7f6-4e5ff968465b service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:40.162467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b91e4a-94db-4258-b7f6-4e5ff968465b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:40.171550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b91e4a-94db-4258-b7f6-4e5ff968465b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:40.173066 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b91e4a-94db-4258-b7f6-4e5ff968465b service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:40.182825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1036/2091] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:40.183614 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91e4a-94db-4258-b7f6-4e5ff968465b service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:40.193218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b91e4a-94db-4258-b7f6-4e5ff968465b service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:40.198391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38618e3-1aea-4529-8a64-1ff6375d9735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:40.198980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38618e3-1aea-4529-8a64-1ff6375d9735 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:40.199267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38618e3-1aea-4529-8a64-1ff6375d9735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:40.199545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38618e3-1aea-4529-8a64-1ff6375d9735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:40.200183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38618e3-1aea-4529-8a64-1ff6375d9735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:40.201791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38618e3-1aea-4529-8a64-1ff6375d9735 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:40.216864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1037/2092] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:40.221525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38618e3-1aea-4529-8a64-1ff6375d9735 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:40.234310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3dc1cdb47a45e5aaba9e42b61403db', 'request_id': 'req-b31be46d-65b5-4a20-9b0f-a974a485d089'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.238225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38618e3-1aea-4529-8a64-1ff6375d9735 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:40.241279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3dc1cdb47a45e5aaba9e42b61403db', 'request_id': 'req-b31be46d-65b5-4a20-9b0f-a974a485d089'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.307800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:40.308457 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:40.308740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:40.309011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] PATH_INFO: `/v3/projects/0af5633a65d5414381be16b53b74ce09/users/21f47cbaa3084658a6b60da569419ba6/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:40.323512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af5633a65d5414381be16b53b74ce09, user_id=21f47cbaa3084658a6b60da569419ba6, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:40.326415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:40.337053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3dc1cdb47a45e5aaba9e42b61403db', 'request_id': 'req-b31be46d-65b5-4a20-9b0f-a974a485d089'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.347879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] The token cache is being invalidate because project fb3dc1cdb47a45e5aaba9e42b61403db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:40.348170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.348828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b31be46d-65b5-4a20-9b0f-a974a485d089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.350367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1056/2093] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:39 2022] DELETE /identity/v3/projects/fb3dc1cdb47a45e5aaba9e42b61403db => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:40.415900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1038/2094] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:40 2022] PUT /identity/v3/projects/0af5633a65d5414381be16b53b74ce09/users/21f47cbaa3084658a6b60da569419ba6/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:35:40.421870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafcb23-8d5a-4d35-9abe-ab9bd1ae39f7 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:40.423228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafcb23-8d5a-4d35-9abe-ab9bd1ae39f7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:40.423228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafcb23-8d5a-4d35-9abe-ab9bd1ae39f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:40.431595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:40.451915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2fafcb23-8d5a-4d35-9abe-ab9bd1ae39f7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:40.454213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2fafcb23-8d5a-4d35-9abe-ab9bd1ae39f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:40.531265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1057/2095] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:40.539875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:40.542969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:40.602072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e09c6-60c2-4558-b9ed-a725b2f728b9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:40.606015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c223a2a-2665-451d-ba13-a942227ae862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:40.606620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c223a2a-2665-451d-ba13-a942227ae862 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:40.606902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c223a2a-2665-451d-ba13-a942227ae862 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:40.607175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c223a2a-2665-451d-ba13-a942227ae862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:40.616691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c223a2a-2665-451d-ba13-a942227ae862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:40.618161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c223a2a-2665-451d-ba13-a942227ae862 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:40.628618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1039/2096] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:40.649893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafcb23-8d5a-4d35-9abe-ab9bd1ae39f7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:40.651338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2fafcb23-8d5a-4d35-9abe-ab9bd1ae39f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:40.665144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafcb23-8d5a-4d35-9abe-ab9bd1ae39f7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:40.669975 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:40.670622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:40.670910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:40.671190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] PATH_INFO: `/v3/projects/fb6cccefd1b24b7eaef129db4e131b6f` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:40.672373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6cccefd1b24b7eaef129db4e131b6f)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:40.674973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:40.774903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6cccefd1b24b7eaef129db4e131b6f', 'request_id': 'req-cd25c3bb-b73e-4c29-baa5-5d649002739f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.784033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6cccefd1b24b7eaef129db4e131b6f', 'request_id': 'req-cd25c3bb-b73e-4c29-baa5-5d649002739f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.863463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6cccefd1b24b7eaef129db4e131b6f', 'request_id': 'req-cd25c3bb-b73e-4c29-baa5-5d649002739f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.876620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] The token cache is being invalidate because project fb6cccefd1b24b7eaef129db4e131b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:40.876951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.884195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:40.886177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1058/2097] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:40 2022] DELETE /identity/v3/projects/fb6cccefd1b24b7eaef129db4e131b6f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:40.892418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c223a2a-2665-451d-ba13-a942227ae862 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:40.910135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c223a2a-2665-451d-ba13-a942227ae862 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:41.000830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:41.001468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:41.001778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:41.002058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] PATH_INFO: `/v3/users/39518b1f099f4a66ae767127e8765680` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:41.003230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39518b1f099f4a66ae767127e8765680)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:41.005231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:41.235383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39518b1f099f4a66ae767127e8765680'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:41.243242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39518b1f099f4a66ae767127e8765680'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:41.244173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39518b1f099f4a66ae767127e8765680'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:41.244767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39518b1f099f4a66ae767127e8765680'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:41.259079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bfdb9398-307d-49e4-9b91-85c3d9774b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39518b1f099f4a66ae767127e8765680'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:41.345517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1040/2098] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:40 2022] DELETE /identity/v3/users/39518b1f099f4a66ae767127e8765680 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:41.406886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:41.472219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:41.775354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:41.776946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:41.791156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25c3bb-b73e-4c29-baa5-5d649002739f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:41.848714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:41.849489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:41.849647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:41.849926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] PATH_INFO: `/v3/projects/a2e0323721194ecb995075c81cdc212e` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:41.852069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e0323721194ecb995075c81cdc212e)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:41.854904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:41.992944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb6750-54dd-4eac-8208-a981074abef2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:41.997264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb6750-54dd-4eac-8208-a981074abef2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:41.997264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb6750-54dd-4eac-8208-a981074abef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.008790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e0323721194ecb995075c81cdc212e', 'request_id': 'req-2133a545-2708-4649-ac51-e2a3b102d750'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:42.016297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e0323721194ecb995075c81cdc212e', 'request_id': 'req-2133a545-2708-4649-ac51-e2a3b102d750'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:42.016517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ebfb6750-54dd-4eac-8208-a981074abef2 None None] MFA Rules not processed for user `148ab9508da34daba05ef09292d92a92`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:42.018474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ebfb6750-54dd-4eac-8208-a981074abef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:42.087269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1041/2099] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:42.125813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e0323721194ecb995075c81cdc212e', 'request_id': 'req-2133a545-2708-4649-ac51-e2a3b102d750'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:42.149179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] The token cache is being invalidate because project a2e0323721194ecb995075c81cdc212e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:42.149475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:42.150206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2133a545-2708-4649-ac51-e2a3b102d750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:42.151709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1059/2100] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:41 2022] DELETE /identity/v3/projects/a2e0323721194ecb995075c81cdc212e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:42.156973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5e90-0a1e-44bb-87f3-a7337271381b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.157376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5e90-0a1e-44bb-87f3-a7337271381b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.157840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5e90-0a1e-44bb-87f3-a7337271381b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.184738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d0fc5e90-0a1e-44bb-87f3-a7337271381b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:42.186443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d0fc5e90-0a1e-44bb-87f3-a7337271381b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:42.263437 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1042/2101] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:42.265144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f052f-b179-47a0-99d0-c1a0be2df5c1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.265432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f052f-b179-47a0-99d0-c1a0be2df5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.265746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f052f-b179-47a0-99d0-c1a0be2df5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.287936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b94f052f-b179-47a0-99d0-c1a0be2df5c1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:42.289224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b94f052f-b179-47a0-99d0-c1a0be2df5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:42.298162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1060/2102] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:42.302459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc5e90-0a1e-44bb-87f3-a7337271381b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:42.312596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc5e90-0a1e-44bb-87f3-a7337271381b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:42.318087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:42.318825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.319231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.319621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.320385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:42.320796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:42.322682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:42.335946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1043/2103] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:42.340187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f052f-b179-47a0-99d0-c1a0be2df5c1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:42.349513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f052f-b179-47a0-99d0-c1a0be2df5c1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:42.354595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cfe3-4cee-4f48-b3e1-20df254b256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:42.355303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cfe3-4cee-4f48-b3e1-20df254b256e admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.355651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cfe3-4cee-4f48-b3e1-20df254b256e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.355999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856cfe3-4cee-4f48-b3e1-20df254b256e admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.356730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856cfe3-4cee-4f48-b3e1-20df254b256e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:42.358827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856cfe3-4cee-4f48-b3e1-20df254b256e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:42.430132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1061/2104] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:42 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:42.431408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:42.442524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ea959-25c0-404b-811e-4699ae9ddb53 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:42.506798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedca278-887e-496f-a723-30439729a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:42.507412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedca278-887e-496f-a723-30439729a40e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.507699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedca278-887e-496f-a723-30439729a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.507982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedca278-887e-496f-a723-30439729a40e admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.508614 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedca278-887e-496f-a723-30439729a40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:42.510611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedca278-887e-496f-a723-30439729a40e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:42.600897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1044/2105] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:42 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:42.605963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cfe3-4cee-4f48-b3e1-20df254b256e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:42.619534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856cfe3-4cee-4f48-b3e1-20df254b256e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:42.624511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef1069-a7f8-4098-a353-bf5221e42c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:42.625258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef1069-a7f8-4098-a353-bf5221e42c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.625690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef1069-a7f8-4098-a353-bf5221e42c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.626196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef1069-a7f8-4098-a353-bf5221e42c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.626961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef1069-a7f8-4098-a353-bf5221e42c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:42.629569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef1069-a7f8-4098-a353-bf5221e42c89 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:42.643426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:42.644254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1062/2106] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:42.646176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedca278-887e-496f-a723-30439729a40e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:42.658383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedca278-887e-496f-a723-30439729a40e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:42.663638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e045fdb-ad09-416b-a96b-ca4ca301a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:42.664281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045fdb-ad09-416b-a96b-ca4ca301a100 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.664698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045fdb-ad09-416b-a96b-ca4ca301a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.665160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045fdb-ad09-416b-a96b-ca4ca301a100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.667058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e045fdb-ad09-416b-a96b-ca4ca301a100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:42.669273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e045fdb-ad09-416b-a96b-ca4ca301a100 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:42.672249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:42.685664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1045/2107] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:42.688248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef1069-a7f8-4098-a353-bf5221e42c89 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:42.699016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef1069-a7f8-4098-a353-bf5221e42c89 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:42.703729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b509e-5669-458b-ba83-a782e446ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:42.704532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b509e-5669-458b-ba83-a782e446ed5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.704888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b509e-5669-458b-ba83-a782e446ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.705262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b509e-5669-458b-ba83-a782e446ed5e admin admin] PATH_INFO: `/v3/projects/923e5aca62b34cfc9f408376925dcf80/users/1874e381825843d2abfc863dc7ed4232/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.722931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b509e-5669-458b-ba83-a782e446ed5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=923e5aca62b34cfc9f408376925dcf80, user_id=1874e381825843d2abfc863dc7ed4232, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:42.725702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b509e-5669-458b-ba83-a782e446ed5e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:42.826744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1063/2108] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:42 2022] PUT /identity/v3/projects/923e5aca62b34cfc9f408376925dcf80/users/1874e381825843d2abfc863dc7ed4232/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:42.837003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfec8d1-75eb-4f8f-9bf4-ba074308d049 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:42.837298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfec8d1-75eb-4f8f-9bf4-ba074308d049 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:42.840315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfec8d1-75eb-4f8f-9bf4-ba074308d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:42.887322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2bfec8d1-75eb-4f8f-9bf4-ba074308d049 None None] MFA Rules not processed for user `1874e381825843d2abfc863dc7ed4232`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:42.888887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2bfec8d1-75eb-4f8f-9bf4-ba074308d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:43.011404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1046/2109] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:43.016389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b509e-5669-458b-ba83-a782e446ed5e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:43.136117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b509e-5669-458b-ba83-a782e446ed5e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:43.150775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7c3d-9167-41a8-a201-37493b84e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:43.151679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7c3d-9167-41a8-a201-37493b84e9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:43.152443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7c3d-9167-41a8-a201-37493b84e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:43.152790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7c3d-9167-41a8-a201-37493b84e9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:43.153564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c7c3d-9167-41a8-a201-37493b84e9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:43.156836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c7c3d-9167-41a8-a201-37493b84e9d0 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:43.318371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1064/2110] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:43 2022] POST /identity/v3/projects => generated 367 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:43.319112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfec8d1-75eb-4f8f-9bf4-ba074308d049 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:43.329800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfec8d1-75eb-4f8f-9bf4-ba074308d049 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:43.406204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3744e4-f84f-45ad-83c5-2566d0e606bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:43.406820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3744e4-f84f-45ad-83c5-2566d0e606bf admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:43.407093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3744e4-f84f-45ad-83c5-2566d0e606bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:43.407366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3744e4-f84f-45ad-83c5-2566d0e606bf admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:43.408013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3744e4-f84f-45ad-83c5-2566d0e606bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:43.410034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3744e4-f84f-45ad-83c5-2566d0e606bf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:43.426139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:43.482630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1047/2111] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:43 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:43.487447 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7c3d-9167-41a8-a201-37493b84e9d0 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:43.497864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7c3d-9167-41a8-a201-37493b84e9d0 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:43.504877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa3ee-0787-4c50-9fc8-e734714b12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:43.506144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa3ee-0787-4c50-9fc8-e734714b12a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:43.506428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa3ee-0787-4c50-9fc8-e734714b12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:43.510807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa3ee-0787-4c50-9fc8-e734714b12a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:43.510807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaa3ee-0787-4c50-9fc8-e734714b12a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:43.510807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaa3ee-0787-4c50-9fc8-e734714b12a8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:43.521795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1065/2112] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:43.526059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3744e4-f84f-45ad-83c5-2566d0e606bf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:43.540063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3744e4-f84f-45ad-83c5-2566d0e606bf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:43.544794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ceb14-29ea-44c6-9f85-dbc85e654de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:43.545482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ceb14-29ea-44c6-9f85-dbc85e654de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:43.545804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ceb14-29ea-44c6-9f85-dbc85e654de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:43.546086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ceb14-29ea-44c6-9f85-dbc85e654de4 admin admin] PATH_INFO: `/v3/projects/41a6da596ab04c4aa69097af9817414d/users/56d31617d4c74427845e40827b9d66a6/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:43.586408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ceb14-29ea-44c6-9f85-dbc85e654de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a6da596ab04c4aa69097af9817414d, user_id=56d31617d4c74427845e40827b9d66a6, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:43.589304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ceb14-29ea-44c6-9f85-dbc85e654de4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:43.686470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1048/2113] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:43 2022] PUT /identity/v3/projects/41a6da596ab04c4aa69097af9817414d/users/56d31617d4c74427845e40827b9d66a6/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:43.690638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa3ee-0787-4c50-9fc8-e734714b12a8 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:43.701637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa3ee-0787-4c50-9fc8-e734714b12a8 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:43.778890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:43.794951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0c8d-968b-40cf-8c32-ced0ed28b6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:43.795946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0c8d-968b-40cf-8c32-ced0ed28b6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:43.796455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0c8d-968b-40cf-8c32-ced0ed28b6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:43.796916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0c8d-968b-40cf-8c32-ced0ed28b6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:43.797975 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c0c8d-968b-40cf-8c32-ced0ed28b6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:43.800812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c0c8d-968b-40cf-8c32-ced0ed28b6f4 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:43.817251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1066/2114] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:43.821406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ceb14-29ea-44c6-9f85-dbc85e654de4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:43.832414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ceb14-29ea-44c6-9f85-dbc85e654de4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:43.839228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:43.840166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:43.840596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:43.840786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] PATH_INFO: `/v3/projects/41a6da596ab04c4aa69097af9817414d/users/56d31617d4c74427845e40827b9d66a6/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:43.843035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a6da596ab04c4aa69097af9817414d, user_id=56d31617d4c74427845e40827b9d66a6, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:43.845851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:43.859407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1049/2115] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:43 2022] PUT /identity/v3/projects/41a6da596ab04c4aa69097af9817414d/users/56d31617d4c74427845e40827b9d66a6/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:43.877376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2d34-55bb-42a1-98c1-888888475052 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:43.877756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2d34-55bb-42a1-98c1-888888475052 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:43.878062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de2d34-55bb-42a1-98c1-888888475052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:43.918512 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e3de2d34-55bb-42a1-98c1-888888475052 None None] MFA Rules not processed for user `56d31617d4c74427845e40827b9d66a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:43.920144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e3de2d34-55bb-42a1-98c1-888888475052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:44.002630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1067/2116] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:44.015902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:44.018764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:44.090630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b102b51-f793-4e60-ac2d-2ba9f06e440c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:44.094579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:44.095226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:44.095513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:44.095793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:44.106791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:44.108880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:44.120841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1050/2117] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:44.354911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:44.431324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2d34-55bb-42a1-98c1-888888475052 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:44.432765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e3de2d34-55bb-42a1-98c1-888888475052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:44.447367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de2d34-55bb-42a1-98c1-888888475052 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:44.451863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa67d0-04b0-45a9-affa-d78552f41798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:44.452633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa67d0-04b0-45a9-affa-d78552f41798 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:44.453021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa67d0-04b0-45a9-affa-d78552f41798 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:44.453374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa67d0-04b0-45a9-affa-d78552f41798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:44.521763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa67d0-04b0-45a9-affa-d78552f41798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:44.523424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa67d0-04b0-45a9-affa-d78552f41798 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:44.533140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1068/2118] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:44.719174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:45.478163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:46.056568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:46.058054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:46.134735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976917a-f00f-4cc8-842a-4097f478236f service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:46.145576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:46.146333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:46.146614 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:46.146883 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] PATH_INFO: `/v3/users/3cd4322a10e846aa8d1d37afe7a4a5d9` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:46.151285 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd4322a10e846aa8d1d37afe7a4a5d9)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:46.154852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:46.172298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:46.384705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd4322a10e846aa8d1d37afe7a4a5d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:46.394882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd4322a10e846aa8d1d37afe7a4a5d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:46.395622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd4322a10e846aa8d1d37afe7a4a5d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:46.396220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd4322a10e846aa8d1d37afe7a4a5d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:46.409365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd4322a10e846aa8d1d37afe7a4a5d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:46.469294 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1051/2119] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:46 2022] DELETE /identity/v3/users/3cd4322a10e846aa8d1d37afe7a4a5d9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:46.474262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d462dc-3ff5-4f9c-a8cc-0470646de0bc None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:46.474797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d462dc-3ff5-4f9c-a8cc-0470646de0bc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:46.475286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d462dc-3ff5-4f9c-a8cc-0470646de0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:46.498047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-61d462dc-3ff5-4f9c-a8cc-0470646de0bc None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:46.499542 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-61d462dc-3ff5-4f9c-a8cc-0470646de0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:46.572980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1069/2120] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:35:46.617167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:46.628053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:46.734806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e966a8-32c1-4057-af45-c8a445ea4640 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:46.738681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620c0ad-a561-47ae-ad28-6e6241433030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:46.739356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c0ad-a561-47ae-ad28-6e6241433030 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:46.739705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c0ad-a561-47ae-ad28-6e6241433030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:46.740044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c0ad-a561-47ae-ad28-6e6241433030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:46.753471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620c0ad-a561-47ae-ad28-6e6241433030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:46.753471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620c0ad-a561-47ae-ad28-6e6241433030 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:46.765657 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1052/2121] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:47.059844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:47.321432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:47.450268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d462dc-3ff5-4f9c-a8cc-0470646de0bc None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:47.452014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-61d462dc-3ff5-4f9c-a8cc-0470646de0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:47.465245 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d462dc-3ff5-4f9c-a8cc-0470646de0bc None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:47.470219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:47.470978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:47.471376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:47.471663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] PATH_INFO: `/v3/projects/35ec9234b44a4c46b67433d4519f2db3` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:47.472942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ec9234b44a4c46b67433d4519f2db3)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:47.474991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:47.496248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800dde0-48e7-43cf-8ce5-5a960ac78e42 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:47.496248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800dde0-48e7-43cf-8ce5-5a960ac78e42 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:47.496248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800dde0-48e7-43cf-8ce5-5a960ac78e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:47.522734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-3800dde0-48e7-43cf-8ce5-5a960ac78e42 None None] MFA Rules not processed for user `21f47cbaa3084658a6b60da569419ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:47.524532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3800dde0-48e7-43cf-8ce5-5a960ac78e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:47.604533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ec9234b44a4c46b67433d4519f2db3', 'request_id': 'req-188f3db1-d234-467e-a924-c6c400cacf06'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:47.611868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1053/2122] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:47.614099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ec9234b44a4c46b67433d4519f2db3', 'request_id': 'req-188f3db1-d234-467e-a924-c6c400cacf06'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:47.627888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800dde0-48e7-43cf-8ce5-5a960ac78e42 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:47.631542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3800dde0-48e7-43cf-8ce5-5a960ac78e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:47.677197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ec9234b44a4c46b67433d4519f2db3', 'request_id': 'req-188f3db1-d234-467e-a924-c6c400cacf06'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:47.694745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] The token cache is being invalidate because project 35ec9234b44a4c46b67433d4519f2db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:47.695051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:47.695735 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-188f3db1-d234-467e-a924-c6c400cacf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:47.698949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1070/2123] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:47 2022] DELETE /identity/v3/projects/35ec9234b44a4c46b67433d4519f2db3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:47.704179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064321e-e2c1-4409-9b8a-dfbd72f2d5af None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:47.704638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064321e-e2c1-4409-9b8a-dfbd72f2d5af None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:47.708008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064321e-e2c1-4409-9b8a-dfbd72f2d5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:47.739465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800dde0-48e7-43cf-8ce5-5a960ac78e42 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:47.749080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2064321e-e2c1-4409-9b8a-dfbd72f2d5af None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:47.752842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2064321e-e2c1-4409-9b8a-dfbd72f2d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:47.831432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:47.832080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:47.832505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:47.832783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:47.835007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:47.867405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1071/2124] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:47.869158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bff6bf-f2b9-4448-8259-8b6a5f39488f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:47.869599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bff6bf-f2b9-4448-8259-8b6a5f39488f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:47.870058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bff6bf-f2b9-4448-8259-8b6a5f39488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:47.894423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-12bff6bf-f2b9-4448-8259-8b6a5f39488f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:47.896603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-12bff6bf-f2b9-4448-8259-8b6a5f39488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:47.912645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1072/2125] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:47.913893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bff6bf-f2b9-4448-8259-8b6a5f39488f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:47.917281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:47.919111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:47.927002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bff6bf-f2b9-4448-8259-8b6a5f39488f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:47.933969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:47.934991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:47.935479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:47.935961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:47.936917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:47.937638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:47.939470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:47.964957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1054/2126] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:47.981078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1073/2127] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:47.986130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:48.032314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292becce-36ee-419d-82a8-313ca31db391 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:48.041541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa665-7729-4d89-875e-dcad18ecbcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:48.042292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa665-7729-4d89-875e-dcad18ecbcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:48.042648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa665-7729-4d89-875e-dcad18ecbcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:48.042985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fa665-7729-4d89-875e-dcad18ecbcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:48.043700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa665-7729-4d89-875e-dcad18ecbcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:48.045949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fa665-7729-4d89-875e-dcad18ecbcf2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:48.165558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1055/2128] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:47 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:48.169572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:48.180713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cd992-addf-4b71-8c72-f2491090493c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:48.270904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97584e07-163e-4178-9927-ae927508384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:48.271533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97584e07-163e-4178-9927-ae927508384b admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:48.271809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97584e07-163e-4178-9927-ae927508384b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:48.272079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97584e07-163e-4178-9927-ae927508384b admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:48.273875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97584e07-163e-4178-9927-ae927508384b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:48.275929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97584e07-163e-4178-9927-ae927508384b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:48.367912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1074/2129] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:48 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:35:48.372315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa665-7729-4d89-875e-dcad18ecbcf2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:48.397604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fa665-7729-4d89-875e-dcad18ecbcf2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:48.409530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca76372-01dc-48e7-9ee5-5c13a1cd4338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:48.410505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca76372-01dc-48e7-9ee5-5c13a1cd4338 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:48.410986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca76372-01dc-48e7-9ee5-5c13a1cd4338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:48.411454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca76372-01dc-48e7-9ee5-5c13a1cd4338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:48.412291 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca76372-01dc-48e7-9ee5-5c13a1cd4338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:48.414280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca76372-01dc-48e7-9ee5-5c13a1cd4338 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:48.419198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:48.438555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1056/2130] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:48.442762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97584e07-163e-4178-9927-ae927508384b admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:48.453957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97584e07-163e-4178-9927-ae927508384b admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:48.463631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe06240-7332-420c-80d6-22c40bf49e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:48.464445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06240-7332-420c-80d6-22c40bf49e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:48.464695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06240-7332-420c-80d6-22c40bf49e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:48.464969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe06240-7332-420c-80d6-22c40bf49e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:48.465645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe06240-7332-420c-80d6-22c40bf49e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:48.467300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe06240-7332-420c-80d6-22c40bf49e41 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:48.495832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1075/2131] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:48.497338 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca76372-01dc-48e7-9ee5-5c13a1cd4338 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:48.514737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca76372-01dc-48e7-9ee5-5c13a1cd4338 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:48.521278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:48.521893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:48.522300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:48.522581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] PATH_INFO: `/v3/projects/3f0f8e4592e741e482483ba47f132c74/users/2c510745d208485ab687b79622b07398/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:48.541025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0f8e4592e741e482483ba47f132c74, user_id=2c510745d208485ab687b79622b07398, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:48.543989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:48.692617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1057/2132] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:48 2022] PUT /identity/v3/projects/3f0f8e4592e741e482483ba47f132c74/users/2c510745d208485ab687b79622b07398/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:48.702937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e4837-ab23-48b3-9a5a-9a40b38801a3 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:48.703235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e4837-ab23-48b3-9a5a-9a40b38801a3 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:48.703519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e4837-ab23-48b3-9a5a-9a40b38801a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:48.757880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f35e4837-ab23-48b3-9a5a-9a40b38801a3 None None] MFA Rules not processed for user `2c510745d208485ab687b79622b07398`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:48.759161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f35e4837-ab23-48b3-9a5a-9a40b38801a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:48.785438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:48.876961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1076/2133] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:48.889222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:48.891010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:49.003421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12e973-890f-4e2f-b8b4-fbb93a82a78a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:49.015335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:49.015978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:49.016263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:49.016538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:49.033182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:49.033182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:49.054083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1058/2134] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:50.609027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:51.058870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:51.128087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fec1ea-980a-4043-b897-3ee8faa46b4c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:51.128624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fec1ea-980a-4043-b897-3ee8faa46b4c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:51.128950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fec1ea-980a-4043-b897-3ee8faa46b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:51.148144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e8fec1ea-980a-4043-b897-3ee8faa46b4c None None] MFA Rules not processed for user `21f47cbaa3084658a6b60da569419ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:51.149351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e8fec1ea-980a-4043-b897-3ee8faa46b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:51.209274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1077/2135] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:51.822015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:51.823423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:51.889287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3c4e7-5221-4342-ba32-d2e7cd078536 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:51.899160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:51.900879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:51.900879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:51.900879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] PATH_INFO: `/v3/users/1874e381825843d2abfc863dc7ed4232` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:51.902001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1874e381825843d2abfc863dc7ed4232)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:51.904223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:52.170802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1874e381825843d2abfc863dc7ed4232'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:52.178389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1874e381825843d2abfc863dc7ed4232'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:52.179088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1874e381825843d2abfc863dc7ed4232'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:52.179695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1874e381825843d2abfc863dc7ed4232'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:52.193276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1874e381825843d2abfc863dc7ed4232'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:52.327127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1059/2136] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:51 2022] DELETE /identity/v3/users/1874e381825843d2abfc863dc7ed4232 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:52.331755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb838a59-4768-461d-b881-f247e67e504b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:52.332271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb838a59-4768-461d-b881-f247e67e504b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:52.332895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb838a59-4768-461d-b881-f247e67e504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:52.351640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-eb838a59-4768-461d-b881-f247e67e504b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:52.352912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-eb838a59-4768-461d-b881-f247e67e504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:52.418111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1078/2137] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:52.428473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:52.430038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:52.492063 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405b651-4007-45a5-93f5-9b2c5e5309ba admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:52.496431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1a08d-4316-4f7a-9a64-a963a1b5a683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:52.497139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a08d-4316-4f7a-9a64-a963a1b5a683 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:52.497494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a08d-4316-4f7a-9a64-a963a1b5a683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:52.497801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a08d-4316-4f7a-9a64-a963a1b5a683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:52.511670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1a08d-4316-4f7a-9a64-a963a1b5a683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:52.514302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1a08d-4316-4f7a-9a64-a963a1b5a683 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:52.524537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1060/2138] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:52.789464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:52.997430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb838a59-4768-461d-b881-f247e67e504b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:52.999270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-eb838a59-4768-461d-b881-f247e67e504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:53.014283 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb838a59-4768-461d-b881-f247e67e504b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:53.020169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:53.020848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:53.032747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:53.032747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] PATH_INFO: `/v3/projects/923e5aca62b34cfc9f408376925dcf80` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:53.032747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923e5aca62b34cfc9f408376925dcf80)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:53.032747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:53.126411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:53.190089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923e5aca62b34cfc9f408376925dcf80', 'request_id': 'req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.199040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923e5aca62b34cfc9f408376925dcf80', 'request_id': 'req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.254815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923e5aca62b34cfc9f408376925dcf80', 'request_id': 'req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.267849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] The token cache is being invalidate because project 923e5aca62b34cfc9f408376925dcf80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:53.268180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.268845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.270398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1079/2139] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:52 2022] DELETE /identity/v3/projects/923e5aca62b34cfc9f408376925dcf80 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:53.274577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1a08d-4316-4f7a-9a64-a963a1b5a683 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:53.284699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1a08d-4316-4f7a-9a64-a963a1b5a683 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:53.342284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:53.342929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:53.343227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:53.343481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] PATH_INFO: `/v3/users/56d31617d4c74427845e40827b9d66a6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:53.344653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d31617d4c74427845e40827b9d66a6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:53.346699 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:53.577802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d31617d4c74427845e40827b9d66a6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.586215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d31617d4c74427845e40827b9d66a6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.587158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d31617d4c74427845e40827b9d66a6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.588169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d31617d4c74427845e40827b9d66a6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.605265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c694804e-9b61-4891-a409-2da308190d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d31617d4c74427845e40827b9d66a6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:53.700082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1061/2140] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:35:53 2022] DELETE /identity/v3/users/56d31617d4c74427845e40827b9d66a6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:54.162475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:54.163974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:54.178264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b013aa9-3819-48e4-b21e-95e1ce40fbb9 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:54.236552 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:54.237801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:54.238083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:54.238362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] PATH_INFO: `/v3/projects/41a6da596ab04c4aa69097af9817414d` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:54.239498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a6da596ab04c4aa69097af9817414d)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:54.241416 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:54.374433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a6da596ab04c4aa69097af9817414d', 'request_id': 'req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:54.382358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a6da596ab04c4aa69097af9817414d', 'request_id': 'req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:54.461382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a6da596ab04c4aa69097af9817414d', 'request_id': 'req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:54.473581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] The token cache is being invalidate because project 41a6da596ab04c4aa69097af9817414d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:35:54.474035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:54.474753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-a6de3ba7-43a2-4cbd-8d92-2ba05261cd0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:35:54.476323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1080/2141] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:35:54 2022] DELETE /identity/v3/projects/41a6da596ab04c4aa69097af9817414d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:54.481315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5073-e512-4f7e-b984-3bc594e2be2a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:54.481832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5073-e512-4f7e-b984-3bc594e2be2a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:54.481947 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5073-e512-4f7e-b984-3bc594e2be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:54.502273 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-430f5073-e512-4f7e-b984-3bc594e2be2a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:54.504012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-430f5073-e512-4f7e-b984-3bc594e2be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:54.577746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1062/2142] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:54.585450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889743-c153-4652-8e07-1ced98dc3092 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:54.585758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889743-c153-4652-8e07-1ced98dc3092 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:54.586040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889743-c153-4652-8e07-1ced98dc3092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:54.608137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-47889743-c153-4652-8e07-1ced98dc3092 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:54.609251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-47889743-c153-4652-8e07-1ced98dc3092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:54.617950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1081/2143] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:54.622267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f5073-e512-4f7e-b984-3bc594e2be2a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:54.632711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f5073-e512-4f7e-b984-3bc594e2be2a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:54.637514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:54.638150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:54.638435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:54.639010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:54.639668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:35:54.639973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:54.641647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:54.653937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1063/2144] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:35:54.658086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47889743-c153-4652-8e07-1ced98dc3092 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:54.667611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47889743-c153-4652-8e07-1ced98dc3092 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:54.672613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88882940-7fc6-4cdb-8bd4-a954c5727917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:54.673253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88882940-7fc6-4cdb-8bd4-a954c5727917 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:54.673535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88882940-7fc6-4cdb-8bd4-a954c5727917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:54.673838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88882940-7fc6-4cdb-8bd4-a954c5727917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:54.675026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88882940-7fc6-4cdb-8bd4-a954c5727917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:54.677016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88882940-7fc6-4cdb-8bd4-a954c5727917 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:54.787796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1082/2145] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:54 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:54.791747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:54.802490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76be78-5c81-447d-94dc-b8b42a1bc6e3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:54.833426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:54.869202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb25237-3666-4351-8652-fabda10a30aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:54.869970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25237-3666-4351-8652-fabda10a30aa admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:54.870311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25237-3666-4351-8652-fabda10a30aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:54.870646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb25237-3666-4351-8652-fabda10a30aa admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:54.871349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb25237-3666-4351-8652-fabda10a30aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:54.873491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb25237-3666-4351-8652-fabda10a30aa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:54.965511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1064/2146] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:54 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:54.966972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88882940-7fc6-4cdb-8bd4-a954c5727917 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:54.979821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88882940-7fc6-4cdb-8bd4-a954c5727917 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:54.986196 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e0916-e824-4045-be4c-dfd8481cef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:54.986868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e0916-e824-4045-be4c-dfd8481cef89 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:54.987147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e0916-e824-4045-be4c-dfd8481cef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:54.987591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e0916-e824-4045-be4c-dfd8481cef89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:54.988239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e0916-e824-4045-be4c-dfd8481cef89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:54.990017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e0916-e824-4045-be4c-dfd8481cef89 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:55.000315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1083/2147] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:55.004972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb25237-3666-4351-8652-fabda10a30aa admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:55.016763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb25237-3666-4351-8652-fabda10a30aa admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:55.022281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38738d23-052b-4952-a14e-cebd13f645d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:55.022919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738d23-052b-4952-a14e-cebd13f645d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:55.023225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738d23-052b-4952-a14e-cebd13f645d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:55.023565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738d23-052b-4952-a14e-cebd13f645d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:55.024205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38738d23-052b-4952-a14e-cebd13f645d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:55.025828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38738d23-052b-4952-a14e-cebd13f645d8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:55.044254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1065/2148] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:35:55.048573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e0916-e824-4045-be4c-dfd8481cef89 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:55.060426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e0916-e824-4045-be4c-dfd8481cef89 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:55.069783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:55.069783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:55.069783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:55.069783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] PATH_INFO: `/v3/projects/b3f9e849e0a8441984a42aa843326b59/users/c14df67dae584d638400a1b85d18440d/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:55.085310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f9e849e0a8441984a42aa843326b59, user_id=c14df67dae584d638400a1b85d18440d, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:55.089738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:55.216778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1084/2149] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:55 2022] PUT /identity/v3/projects/b3f9e849e0a8441984a42aa843326b59/users/c14df67dae584d638400a1b85d18440d/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:55.218516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ff16-0c6c-4600-8529-a0e5ef571517 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:55.218820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ff16-0c6c-4600-8529-a0e5ef571517 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:55.219102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ff16-0c6c-4600-8529-a0e5ef571517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:55.241471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-a535ff16-0c6c-4600-8529-a0e5ef571517 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:55.242813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a535ff16-0c6c-4600-8529-a0e5ef571517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:55.321139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1066/2150] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:55.344837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:55.347172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:55.443497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198ab05-f05a-4270-9a1f-ba060c565aea admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:55.450136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41168c-d0f2-44f6-b93f-09dd0fec74c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:55.452429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41168c-d0f2-44f6-b93f-09dd0fec74c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:55.452429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41168c-d0f2-44f6-b93f-09dd0fec74c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:55.452429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41168c-d0f2-44f6-b93f-09dd0fec74c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:55.463326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41168c-d0f2-44f6-b93f-09dd0fec74c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:55.464790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41168c-d0f2-44f6-b93f-09dd0fec74c0 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:55.477106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:55.477773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1085/2151] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:35:56.832513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:57.318640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:57.497237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caabf64-8313-4129-81e6-6bece719c28d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:57.497523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caabf64-8313-4129-81e6-6bece719c28d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:57.500200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caabf64-8313-4129-81e6-6bece719c28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:57.527492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7caabf64-8313-4129-81e6-6bece719c28d None None] MFA Rules not processed for user `c14df67dae584d638400a1b85d18440d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:35:57.528884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7caabf64-8313-4129-81e6-6bece719c28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:35:57.611096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1067/2152] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:35:57.615825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41168c-d0f2-44f6-b93f-09dd0fec74c0 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:57.638024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41168c-d0f2-44f6-b93f-09dd0fec74c0 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:57.652954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b593c-114f-4763-a3a0-ae9801c822f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:57.654245 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b593c-114f-4763-a3a0-ae9801c822f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:57.655637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b593c-114f-4763-a3a0-ae9801c822f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:57.656161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b593c-114f-4763-a3a0-ae9801c822f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:57.659168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b593c-114f-4763-a3a0-ae9801c822f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:57.666635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b593c-114f-4763-a3a0-ae9801c822f8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:57.853651 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1086/2153] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:35:57 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:57.855622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caabf64-8313-4129-81e6-6bece719c28d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:57.867213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caabf64-8313-4129-81e6-6bece719c28d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:57.954220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07524-96e1-4562-a81f-f08b78013f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:57.954868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07524-96e1-4562-a81f-f08b78013f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:57.955148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07524-96e1-4562-a81f-f08b78013f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:57.955419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07524-96e1-4562-a81f-f08b78013f0a admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:57.956427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e07524-96e1-4562-a81f-f08b78013f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:57.958439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e07524-96e1-4562-a81f-f08b78013f0a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:58.057504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1068/2154] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:35:57 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:35:58.061089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b593c-114f-4763-a3a0-ae9801c822f8 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:58.071504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b593c-114f-4763-a3a0-ae9801c822f8 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:58.076014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1a3f8-7611-4557-81cb-660575f74dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:58.076628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1a3f8-7611-4557-81cb-660575f74dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:58.076909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1a3f8-7611-4557-81cb-660575f74dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:58.077180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1a3f8-7611-4557-81cb-660575f74dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:58.077851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1a3f8-7611-4557-81cb-660575f74dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:58.079498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1a3f8-7611-4557-81cb-660575f74dc4 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:58.089794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1087/2155] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:58.100257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07524-96e1-4562-a81f-f08b78013f0a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:58.110378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07524-96e1-4562-a81f-f08b78013f0a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:58.115946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602a1d-be31-4438-ac7b-84fd92f205f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:58.116605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602a1d-be31-4438-ac7b-84fd92f205f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:58.116889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602a1d-be31-4438-ac7b-84fd92f205f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:58.117158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0602a1d-be31-4438-ac7b-84fd92f205f2 admin admin] PATH_INFO: `/v3/projects/c8125c6d3cd44e3abe7f5e4f10ed1527/users/44f5a9165c8042209278cef6c5cc8386/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:58.133946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0602a1d-be31-4438-ac7b-84fd92f205f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8125c6d3cd44e3abe7f5e4f10ed1527, user_id=44f5a9165c8042209278cef6c5cc8386, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:58.139039 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0602a1d-be31-4438-ac7b-84fd92f205f2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:58.270735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1069/2156] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:58 2022] PUT /identity/v3/projects/c8125c6d3cd44e3abe7f5e4f10ed1527/users/44f5a9165c8042209278cef6c5cc8386/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:58.275036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1a3f8-7611-4557-81cb-660575f74dc4 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:58.286176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1a3f8-7611-4557-81cb-660575f74dc4 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:58.376398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a2c83-4812-490e-a080-81cd3d7b0eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:58.377950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a2c83-4812-490e-a080-81cd3d7b0eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:58.378494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a2c83-4812-490e-a080-81cd3d7b0eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:58.381402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a2c83-4812-490e-a080-81cd3d7b0eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:58.381402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a2c83-4812-490e-a080-81cd3d7b0eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:58.381672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a2c83-4812-490e-a080-81cd3d7b0eb6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:58.396103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1088/2157] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:35:58.404095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602a1d-be31-4438-ac7b-84fd92f205f2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:35:58.425922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0602a1d-be31-4438-ac7b-84fd92f205f2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:35:58.432096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cd81c-eebb-47a7-afd3-6c082e50f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:35:58.432349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cd81c-eebb-47a7-afd3-6c082e50f8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:58.432677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cd81c-eebb-47a7-afd3-6c082e50f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:58.433030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cd81c-eebb-47a7-afd3-6c082e50f8e9 admin admin] PATH_INFO: `/v3/projects/c8125c6d3cd44e3abe7f5e4f10ed1527/users/44f5a9165c8042209278cef6c5cc8386/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:35:58.435248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cd81c-eebb-47a7-afd3-6c082e50f8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8125c6d3cd44e3abe7f5e4f10ed1527, user_id=44f5a9165c8042209278cef6c5cc8386, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:35:58.438447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cd81c-eebb-47a7-afd3-6c082e50f8e9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:35:58.453602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1070/2158] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:35:58 2022] PUT /identity/v3/projects/c8125c6d3cd44e3abe7f5e4f10ed1527/users/44f5a9165c8042209278cef6c5cc8386/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:35:58.766581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:59.166495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:35:59.994250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85364a-daf9-4920-b873-56db1aad8b1b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:35:59.994805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85364a-daf9-4920-b873-56db1aad8b1b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:35:59.994959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85364a-daf9-4920-b873-56db1aad8b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:00.025695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-bd85364a-daf9-4920-b873-56db1aad8b1b None None] MFA Rules not processed for user `44f5a9165c8042209278cef6c5cc8386`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:00.032118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bd85364a-daf9-4920-b873-56db1aad8b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:00.104427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1089/2159] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:00.116480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d287b9-ce5c-4b4e-ae8c-d6b82b1e70e3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:00.116928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d287b9-ce5c-4b4e-ae8c-d6b82b1e70e3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:00.118141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d287b9-ce5c-4b4e-ae8c-d6b82b1e70e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:00.126337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:00.152131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-36d287b9-ce5c-4b4e-ae8c-d6b82b1e70e3 None None] MFA Rules not processed for user `c14df67dae584d638400a1b85d18440d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:00.153819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-36d287b9-ce5c-4b4e-ae8c-d6b82b1e70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:00.218280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1071/2160] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:00.230843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85364a-daf9-4920-b873-56db1aad8b1b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:00.232145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bd85364a-daf9-4920-b873-56db1aad8b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:00.324444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85364a-daf9-4920-b873-56db1aad8b1b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:00.330883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91ab30-172b-4380-963f-f1cbe4647e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:00.331875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91ab30-172b-4380-963f-f1cbe4647e44 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:00.332380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91ab30-172b-4380-963f-f1cbe4647e44 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:00.333856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:00.334413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91ab30-172b-4380-963f-f1cbe4647e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:00.342408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91ab30-172b-4380-963f-f1cbe4647e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:00.344043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91ab30-172b-4380-963f-f1cbe4647e44 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:00.353480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1090/2161] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:36:01.270173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:01.563685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:01.681227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:03.277637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:04.023428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:04.426491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:05.271550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:05.517973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:05.888645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:05.983339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:06.110079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:06.138065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:06.486935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:06.591836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:06.855277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:07.003811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:07.129173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:07.363118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:07.389638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:07.620629 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:07.803776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:07.875890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d287b9-ce5c-4b4e-ae8c-d6b82b1e70e3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:07.879178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-36d287b9-ce5c-4b4e-ae8c-d6b82b1e70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:07.959620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d287b9-ce5c-4b4e-ae8c-d6b82b1e70e3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:07.966525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:07.967178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:07.967465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:07.967743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] PATH_INFO: `/v3/users/2c510745d208485ab687b79622b07398` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:07.968881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c510745d208485ab687b79622b07398)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:07.970983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:08.097774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:08.305769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c510745d208485ab687b79622b07398'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:08.317444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c510745d208485ab687b79622b07398'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:08.320710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c510745d208485ab687b79622b07398'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:08.321432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c510745d208485ab687b79622b07398'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:08.342211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c510745d208485ab687b79622b07398'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:08.417253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1072/2162] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:36:07 2022] DELETE /identity/v3/users/2c510745d208485ab687b79622b07398 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:08.421543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaf87a-c0c6-4cda-a0a4-7f2ab2344671 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:08.422468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaf87a-c0c6-4cda-a0a4-7f2ab2344671 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:08.422972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeaf87a-c0c6-4cda-a0a4-7f2ab2344671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:08.444656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-0aeaf87a-c0c6-4cda-a0a4-7f2ab2344671 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:08.448309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0aeaf87a-c0c6-4cda-a0a4-7f2ab2344671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:08.517957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:08.535414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1091/2163] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:08.545209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:08.546868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:08.620690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:08.632116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11455170-5592-4b1a-8629-b913886f5fc1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:08.636802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6f4e2-edaa-4beb-9b10-e560e4d394fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:08.637562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6f4e2-edaa-4beb-9b10-e560e4d394fa service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:08.638140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6f4e2-edaa-4beb-9b10-e560e4d394fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:08.638140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6f4e2-edaa-4beb-9b10-e560e4d394fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:08.651451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6f4e2-edaa-4beb-9b10-e560e4d394fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:08.653025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6f4e2-edaa-4beb-9b10-e560e4d394fa service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:08.675280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1073/2164] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:36:08.955613 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:09.075756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:09.148575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaf87a-c0c6-4cda-a0a4-7f2ab2344671 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:09.150128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0aeaf87a-c0c6-4cda-a0a4-7f2ab2344671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:09.163417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeaf87a-c0c6-4cda-a0a4-7f2ab2344671 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:09.173420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:09.173796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:09.174043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:09.174390 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] PATH_INFO: `/v3/projects/3f0f8e4592e741e482483ba47f132c74` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:09.176316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0f8e4592e741e482483ba47f132c74)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:09.179205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:09.372267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0f8e4592e741e482483ba47f132c74', 'request_id': 'req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:09.385033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0f8e4592e741e482483ba47f132c74', 'request_id': 'req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:09.472542 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0f8e4592e741e482483ba47f132c74', 'request_id': 'req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:09.484183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] The token cache is being invalidate because project 3f0f8e4592e741e482483ba47f132c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:36:09.484477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:09.485123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7b7624b-aeb5-4dbc-bac6-d622bb8b51df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:09.486742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1092/2165] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:36:09 2022] DELETE /identity/v3/projects/3f0f8e4592e741e482483ba47f132c74 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:36:09.492134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3092924-d3d5-42a7-81e2-ef399f889516 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:09.492425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3092924-d3d5-42a7-81e2-ef399f889516 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:09.492733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3092924-d3d5-42a7-81e2-ef399f889516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:09.513050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e3092924-d3d5-42a7-81e2-ef399f889516 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:09.514878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e3092924-d3d5-42a7-81e2-ef399f889516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:09.591333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1074/2166] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:09.600031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213061e-e678-4f19-9ed7-fe6b8fb84195 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:09.600437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213061e-e678-4f19-9ed7-fe6b8fb84195 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:09.600843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213061e-e678-4f19-9ed7-fe6b8fb84195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:09.621740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-3213061e-e678-4f19-9ed7-fe6b8fb84195 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:09.622974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3213061e-e678-4f19-9ed7-fe6b8fb84195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:09.632200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1093/2167] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:36:09.636449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3092924-d3d5-42a7-81e2-ef399f889516 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:09.646872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3092924-d3d5-42a7-81e2-ef399f889516 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:09.651603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:09.652206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:09.652490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:09.652767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:09.653473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:36:09.653853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:09.655458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:09.663632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:09.670587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1075/2168] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:36:09.673559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213061e-e678-4f19-9ed7-fe6b8fb84195 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:09.685661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213061e-e678-4f19-9ed7-fe6b8fb84195 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:09.690751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae7982-4a0a-49e4-bfda-0851712c7d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:09.691356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae7982-4a0a-49e4-bfda-0851712c7d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:09.691616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae7982-4a0a-49e4-bfda-0851712c7d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:09.691946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae7982-4a0a-49e4-bfda-0851712c7d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:09.692633 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae7982-4a0a-49e4-bfda-0851712c7d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:09.694561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae7982-4a0a-49e4-bfda-0851712c7d0c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:09.810397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1094/2169] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:36:09 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:36:09.814766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:09.824772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecce0c-1a90-46bd-8d4e-95a1a794a31e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:09.882079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fd8b0-0e5c-4a27-9922-930b836e38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:09.882721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fd8b0-0e5c-4a27-9922-930b836e38bb admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:09.883028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fd8b0-0e5c-4a27-9922-930b836e38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:09.883302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fd8b0-0e5c-4a27-9922-930b836e38bb admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:09.883979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fd8b0-0e5c-4a27-9922-930b836e38bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:09.886007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fd8b0-0e5c-4a27-9922-930b836e38bb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:10.021830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1076/2170] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:36:09 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:36:10.025785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae7982-4a0a-49e4-bfda-0851712c7d0c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:10.036022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae7982-4a0a-49e4-bfda-0851712c7d0c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:10.040808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f42e9-614b-4207-87de-ed1db8c2d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:10.041418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f42e9-614b-4207-87de-ed1db8c2d93e admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:10.041731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f42e9-614b-4207-87de-ed1db8c2d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:10.042009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f42e9-614b-4207-87de-ed1db8c2d93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:10.042661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f42e9-614b-4207-87de-ed1db8c2d93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:10.044259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f42e9-614b-4207-87de-ed1db8c2d93e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:10.054159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1095/2171] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:36:10.060330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fd8b0-0e5c-4a27-9922-930b836e38bb admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:10.070483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fd8b0-0e5c-4a27-9922-930b836e38bb admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:10.075377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c261d5-a705-453f-8a9b-9f0f6fdb1cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:10.076023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c261d5-a705-453f-8a9b-9f0f6fdb1cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:10.076274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c261d5-a705-453f-8a9b-9f0f6fdb1cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:10.076548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c261d5-a705-453f-8a9b-9f0f6fdb1cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:10.077202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c261d5-a705-453f-8a9b-9f0f6fdb1cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:10.078865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c261d5-a705-453f-8a9b-9f0f6fdb1cdb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:10.091072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1077/2172] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:36:10.095240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f42e9-614b-4207-87de-ed1db8c2d93e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:10.105445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f42e9-614b-4207-87de-ed1db8c2d93e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:10.110068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:10.110766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:10.111074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:10.111348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] PATH_INFO: `/v3/projects/a7061e119f124388b5e9e9aeb8aedf54/users/637dfded83cb4792a724ba98e73e43ce/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:10.125742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7061e119f124388b5e9e9aeb8aedf54, user_id=637dfded83cb4792a724ba98e73e43ce, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:10.128857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:10.191719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1096/2173] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:36:10 2022] PUT /identity/v3/projects/a7061e119f124388b5e9e9aeb8aedf54/users/637dfded83cb4792a724ba98e73e43ce/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:10.201848 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67707-2a9e-4f30-b72c-6b343736204f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:10.202169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67707-2a9e-4f30-b72c-6b343736204f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:10.202444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67707-2a9e-4f30-b72c-6b343736204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:10.230223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7ea67707-2a9e-4f30-b72c-6b343736204f None None] MFA Rules not processed for user `637dfded83cb4792a724ba98e73e43ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:10.231463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7ea67707-2a9e-4f30-b72c-6b343736204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:10.270785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:10.305814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:10.325922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1078/2174] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:10.337979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:10.340016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:10.410296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d27b7d-cf0d-4680-8e9c-26fcfbfb4b61 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:10.414179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f22e1e-bed3-4584-990c-7071319b9eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:10.414895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22e1e-bed3-4584-990c-7071319b9eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:10.415367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22e1e-bed3-4584-990c-7071319b9eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:10.415641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22e1e-bed3-4584-990c-7071319b9eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:10.425669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f22e1e-bed3-4584-990c-7071319b9eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:10.427286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f22e1e-bed3-4584-990c-7071319b9eb3 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:10.436381 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1097/2175] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:36:10.501483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:20.603752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:20.654433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:21.893460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea67707-2a9e-4f30-b72c-6b343736204f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:21.903016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea67707-2a9e-4f30-b72c-6b343736204f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:21.906898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1894bbb-259a-4241-98b4-369184a4a25e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:21.907892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894bbb-259a-4241-98b4-369184a4a25e service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:21.910997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894bbb-259a-4241-98b4-369184a4a25e service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:21.910997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894bbb-259a-4241-98b4-369184a4a25e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:21.911962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a1894bbb-259a-4241-98b4-369184a4a25e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:21.982799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1894bbb-259a-4241-98b4-369184a4a25e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:21.984360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1894bbb-259a-4241-98b4-369184a4a25e service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:21.994870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1079/2176] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:36:23.166333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f22e1e-bed3-4584-990c-7071319b9eb3 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:23.257322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f22e1e-bed3-4584-990c-7071319b9eb3 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:23.262525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:23.263636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:23.263927 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:23.264204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] PATH_INFO: `/v3/users/637dfded83cb4792a724ba98e73e43ce` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:23.265977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=637dfded83cb4792a724ba98e73e43ce)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:23.267918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:23.504177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637dfded83cb4792a724ba98e73e43ce'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:23.504864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637dfded83cb4792a724ba98e73e43ce'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:23.505479 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637dfded83cb4792a724ba98e73e43ce'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:23.580444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637dfded83cb4792a724ba98e73e43ce'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:23.592929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637dfded83cb4792a724ba98e73e43ce'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:23.605650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1098/2177] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:36:23 2022] DELETE /identity/v3/users/637dfded83cb4792a724ba98e73e43ce => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:23.610160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16923-0064-48e4-b983-ca68f943bca7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:23.610737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16923-0064-48e4-b983-ca68f943bca7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:23.610962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16923-0064-48e4-b983-ca68f943bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:23.632460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-9fa16923-0064-48e4-b983-ca68f943bca7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:23.633811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9fa16923-0064-48e4-b983-ca68f943bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:23.693033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1080/2178] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:23.702711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:23.704487 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:23.771106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db250b77-fa49-4db3-80ef-69208556f10a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:23.774787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f99a7-3ded-4197-9710-4f6f7129fc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:23.775428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f99a7-3ded-4197-9710-4f6f7129fc29 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:23.775711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f99a7-3ded-4197-9710-4f6f7129fc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:23.775985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f99a7-3ded-4197-9710-4f6f7129fc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:23.785836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f99a7-3ded-4197-9710-4f6f7129fc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:23.787321 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f99a7-3ded-4197-9710-4f6f7129fc29 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:23.797247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1099/2179] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:36:24.325665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16923-0064-48e4-b983-ca68f943bca7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:24.329043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9fa16923-0064-48e4-b983-ca68f943bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:24.363592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16923-0064-48e4-b983-ca68f943bca7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:24.370512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:24.370512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:24.370512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:24.370798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] PATH_INFO: `/v3/projects/a7061e119f124388b5e9e9aeb8aedf54` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:24.371880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7061e119f124388b5e9e9aeb8aedf54)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:24.373866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:24.506395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7061e119f124388b5e9e9aeb8aedf54', 'request_id': 'req-2633a47c-46bf-4529-b1a2-2d1749ed1de1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:24.592225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7061e119f124388b5e9e9aeb8aedf54', 'request_id': 'req-2633a47c-46bf-4529-b1a2-2d1749ed1de1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:24.599464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7061e119f124388b5e9e9aeb8aedf54', 'request_id': 'req-2633a47c-46bf-4529-b1a2-2d1749ed1de1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:24.611379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] The token cache is being invalidate because project a7061e119f124388b5e9e9aeb8aedf54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:36:24.612524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:24.613021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-2633a47c-46bf-4529-b1a2-2d1749ed1de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:24.615200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1081/2180] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:36:24 2022] DELETE /identity/v3/projects/a7061e119f124388b5e9e9aeb8aedf54 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:36:24.621099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5fd5-b0d8-4236-a64d-7cefd6ee29cb None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:24.622285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5fd5-b0d8-4236-a64d-7cefd6ee29cb None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:24.622720 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf5fd5-b0d8-4236-a64d-7cefd6ee29cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:24.644170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-5baf5fd5-b0d8-4236-a64d-7cefd6ee29cb None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:24.645525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5baf5fd5-b0d8-4236-a64d-7cefd6ee29cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:24.663692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:24.706450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1100/2181] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:24.714402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8890-5d68-40d2-8893-9c7e7c02ff8a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:24.714691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8890-5d68-40d2-8893-9c7e7c02ff8a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:24.714967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f8890-5d68-40d2-8893-9c7e7c02ff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:24.734445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-273f8890-5d68-40d2-8893-9c7e7c02ff8a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:24.735644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-273f8890-5d68-40d2-8893-9c7e7c02ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:24.744065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1082/2182] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:24.748282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf5fd5-b0d8-4236-a64d-7cefd6ee29cb None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:24.758391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf5fd5-b0d8-4236-a64d-7cefd6ee29cb None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:24.762962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:24.763547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:24.763831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:24.764111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:24.764758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:36:24.765316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:24.766955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:24.778303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1101/2183] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:36:24.782754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f8890-5d68-40d2-8893-9c7e7c02ff8a None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:24.792507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f8890-5d68-40d2-8893-9c7e7c02ff8a None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:24.797278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6bc9e-5abc-430a-be2a-3310d73d4bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:24.797910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6bc9e-5abc-430a-be2a-3310d73d4bad admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:24.803257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6bc9e-5abc-430a-be2a-3310d73d4bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:24.803257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6bc9e-5abc-430a-be2a-3310d73d4bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:24.803257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6bc9e-5abc-430a-be2a-3310d73d4bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:24.803257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6bc9e-5abc-430a-be2a-3310d73d4bad admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:24.810943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:24.893451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1083/2184] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:36:24 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:36:24.897648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:24.908104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d8b4-6508-46e7-a73b-5fc4096685c0 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:24.969687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc37c3-2830-4557-a4fa-ff0bd5ec328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:24.970293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc37c3-2830-4557-a4fa-ff0bd5ec328f admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:24.970578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc37c3-2830-4557-a4fa-ff0bd5ec328f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:24.970853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc37c3-2830-4557-a4fa-ff0bd5ec328f admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:24.972009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc37c3-2830-4557-a4fa-ff0bd5ec328f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:24.974031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc37c3-2830-4557-a4fa-ff0bd5ec328f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:25.061887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1102/2185] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:36:24 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:36:25.063120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6bc9e-5abc-430a-be2a-3310d73d4bad admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:25.075482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6bc9e-5abc-430a-be2a-3310d73d4bad admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:25.080292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67824a06-9a49-4ee4-b569-f101761d01aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:25.080966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824a06-9a49-4ee4-b569-f101761d01aa admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:25.081321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824a06-9a49-4ee4-b569-f101761d01aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:25.081695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824a06-9a49-4ee4-b569-f101761d01aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:25.082502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67824a06-9a49-4ee4-b569-f101761d01aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:25.084153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67824a06-9a49-4ee4-b569-f101761d01aa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:25.094862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1084/2186] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:36:25.099388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc37c3-2830-4557-a4fa-ff0bd5ec328f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:25.110050 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc37c3-2830-4557-a4fa-ff0bd5ec328f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:25.115375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf827d-9921-4bdb-91ea-a5ec77b489a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:25.115972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf827d-9921-4bdb-91ea-a5ec77b489a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:25.116249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf827d-9921-4bdb-91ea-a5ec77b489a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:25.116519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf827d-9921-4bdb-91ea-a5ec77b489a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:25.117159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf827d-9921-4bdb-91ea-a5ec77b489a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:25.118787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf827d-9921-4bdb-91ea-a5ec77b489a1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:25.129064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1103/2187] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:36:25.133128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67824a06-9a49-4ee4-b569-f101761d01aa admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:25.143351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67824a06-9a49-4ee4-b569-f101761d01aa admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:25.147957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:25.148600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:25.148882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:25.149174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] PATH_INFO: `/v3/projects/94512035a58945b58b1ee99b224b2666/users/294684f6e382400cba20ff999b1b7e67/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:25.164376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94512035a58945b58b1ee99b224b2666, user_id=294684f6e382400cba20ff999b1b7e67, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:25.167044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:25.255686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1085/2188] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:36:25 2022] PUT /identity/v3/projects/94512035a58945b58b1ee99b224b2666/users/294684f6e382400cba20ff999b1b7e67/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:25.266405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312d10-7857-444e-bf49-799d40f0485e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:25.266693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312d10-7857-444e-bf49-799d40f0485e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:25.266967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312d10-7857-444e-bf49-799d40f0485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:25.417628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f1312d10-7857-444e-bf49-799d40f0485e None None] MFA Rules not processed for user `294684f6e382400cba20ff999b1b7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:25.418850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f1312d10-7857-444e-bf49-799d40f0485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:25.481523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1104/2189] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:25.492758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:25.494557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:25.557352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd14eb-f2b4-4621-a6b2-618bd46f1481 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:25.560959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1339f-1395-496f-8adb-cb1a11491f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:25.561578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1339f-1395-496f-8adb-cb1a11491f12 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:25.561881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1339f-1395-496f-8adb-cb1a11491f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:25.562154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1339f-1395-496f-8adb-cb1a11491f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:25.572147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1339f-1395-496f-8adb-cb1a11491f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:25.573632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1339f-1395-496f-8adb-cb1a11491f12 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:25.583580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1086/2190] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:36:27.526182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a545c-edf2-4bde-9f0e-8dbecbec7f4a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:27.527167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a545c-edf2-4bde-9f0e-8dbecbec7f4a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:27.527758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a545c-edf2-4bde-9f0e-8dbecbec7f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:27.562577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-608a545c-edf2-4bde-9f0e-8dbecbec7f4a None None] MFA Rules not processed for user `294684f6e382400cba20ff999b1b7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:27.564589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-608a545c-edf2-4bde-9f0e-8dbecbec7f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:27.577106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1105/2191] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:33.527607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a626ac-f5ad-421b-9c32-5f9ec0b7ebdb None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:33.528231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a626ac-f5ad-421b-9c32-5f9ec0b7ebdb None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:33.528231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a626ac-f5ad-421b-9c32-5f9ec0b7ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:33.557450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-07a626ac-f5ad-421b-9c32-5f9ec0b7ebdb None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:33.558644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-07a626ac-f5ad-421b-9c32-5f9ec0b7ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:33.625751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1087/2192] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:36:33.679225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a545c-edf2-4bde-9f0e-8dbecbec7f4a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:33.680785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-608a545c-edf2-4bde-9f0e-8dbecbec7f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:33.695126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:33.763560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a545c-edf2-4bde-9f0e-8dbecbec7f4a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:33.769504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf880969-9af5-48dd-a2b0-4207c6c0c6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:33.770380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880969-9af5-48dd-a2b0-4207c6c0c6e4 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:33.770822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880969-9af5-48dd-a2b0-4207c6c0c6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:33.771257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf880969-9af5-48dd-a2b0-4207c6c0c6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:33.783634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf880969-9af5-48dd-a2b0-4207c6c0c6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:33.783634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf880969-9af5-48dd-a2b0-4207c6c0c6e4 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:33.793282 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1106/2193] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:36:37.455499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdde8-7c21-402a-9449-cba0be4f57c3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:37.456645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdde8-7c21-402a-9449-cba0be4f57c3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:37.456645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdde8-7c21-402a-9449-cba0be4f57c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:37.478075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-6d3cdde8-7c21-402a-9449-cba0be4f57c3 None None] MFA Rules not processed for user `ab934520bd5e4a5e9c82fdfacbf99f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:37.479513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6d3cdde8-7c21-402a-9449-cba0be4f57c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:37.547382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1088/2194] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:44.036597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=29 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:44.962254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba300-e1fb-4254-88dd-19a844e7290e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:44.962538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba300-e1fb-4254-88dd-19a844e7290e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:44.962814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba300-e1fb-4254-88dd-19a844e7290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:44.989359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-178ba300-e1fb-4254-88dd-19a844e7290e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:44.990975 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-178ba300-e1fb-4254-88dd-19a844e7290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:44.999426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1107/2195] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:45.184990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cdde8-7c21-402a-9449-cba0be4f57c3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:45.194428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:45.209834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cdde8-7c21-402a-9449-cba0be4f57c3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:45.213659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:45.213659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:45.213659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:45.213659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:45.223400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:45.225899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:45.245014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1089/2196] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:36:48.940381 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832751-78d9-4663-8201-80e46a58a46b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:48.941230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832751-78d9-4663-8201-80e46a58a46b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:48.941963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832751-78d9-4663-8201-80e46a58a46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:48.981973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4e832751-78d9-4663-8201-80e46a58a46b None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:48.983323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4e832751-78d9-4663-8201-80e46a58a46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:49.072351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1108/2197] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:49.118012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:49.119626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:49.246454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897317-da37-403c-aafe-c8e0ec82abb9 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:49.253112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5249b2-0681-45f0-a56f-0ba2c8a2cf5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:49.254459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5249b2-0681-45f0-a56f-0ba2c8a2cf5d service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:49.254459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5249b2-0681-45f0-a56f-0ba2c8a2cf5d service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:49.254832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5249b2-0681-45f0-a56f-0ba2c8a2cf5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:49.265208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5249b2-0681-45f0-a56f-0ba2c8a2cf5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:49.267731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5249b2-0681-45f0-a56f-0ba2c8a2cf5d service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:49.310301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1090/2198] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:36:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:36:51.781793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25777a25-994a-4155-8887-2220c5be3397 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:51.782983 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25777a25-994a-4155-8887-2220c5be3397 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:51.784143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25777a25-994a-4155-8887-2220c5be3397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:51.808838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-25777a25-994a-4155-8887-2220c5be3397 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:51.810366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-25777a25-994a-4155-8887-2220c5be3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:51.829939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1109/2199] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:51.858327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5249b2-0681-45f0-a56f-0ba2c8a2cf5d service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:51.878697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5249b2-0681-45f0-a56f-0ba2c8a2cf5d service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:51.897028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee060-0242-4a92-ab57-6e156f79752e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:51.897990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee060-0242-4a92-ab57-6e156f79752e service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:51.898516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee060-0242-4a92-ab57-6e156f79752e service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:51.898801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee060-0242-4a92-ab57-6e156f79752e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:51.911866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bee060-0242-4a92-ab57-6e156f79752e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:51.913582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bee060-0242-4a92-ab57-6e156f79752e service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:51.925030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1091/2200] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:36:53.672199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25777a25-994a-4155-8887-2220c5be3397 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:53.676541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-25777a25-994a-4155-8887-2220c5be3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:53.696712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25777a25-994a-4155-8887-2220c5be3397 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:53.709273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:53.710294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:53.710524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:53.710793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] PATH_INFO: `/v3/users/c14df67dae584d638400a1b85d18440d` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:53.712710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14df67dae584d638400a1b85d18440d)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:53.716590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:53.968188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14df67dae584d638400a1b85d18440d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:53.969446 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14df67dae584d638400a1b85d18440d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:53.970994 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14df67dae584d638400a1b85d18440d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:54.041939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14df67dae584d638400a1b85d18440d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:54.061087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14df67dae584d638400a1b85d18440d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:54.082333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1110/2201] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:36:53 2022] DELETE /identity/v3/users/c14df67dae584d638400a1b85d18440d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:54.418243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee060-0242-4a92-ab57-6e156f79752e service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:54.431822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee060-0242-4a92-ab57-6e156f79752e service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:54.570582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:54.571274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:54.571561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:54.571836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] PATH_INFO: `/v3/projects/b3f9e849e0a8441984a42aa843326b59` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:54.573059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f9e849e0a8441984a42aa843326b59)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:54.575250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:54.770121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f9e849e0a8441984a42aa843326b59', 'request_id': 'req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:54.851056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f9e849e0a8441984a42aa843326b59', 'request_id': 'req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:54.858537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f9e849e0a8441984a42aa843326b59', 'request_id': 'req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:54.870024 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:54.886944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] The token cache is being invalidate because project b3f9e849e0a8441984a42aa843326b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:36:54.887514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:54.892422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:54.895668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1092/2202] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:36:54 2022] DELETE /identity/v3/projects/b3f9e849e0a8441984a42aa843326b59 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:54.899518 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:54.901877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:54.924503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562eb9-fccc-4e93-bcc0-95c379e622cd admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:55.025433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:55.026940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:55.027380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:55.027835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] PATH_INFO: `/v3/users/44f5a9165c8042209278cef6c5cc8386` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:55.033557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f5a9165c8042209278cef6c5cc8386)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:55.036459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:55.042244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:55.271053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f5a9165c8042209278cef6c5cc8386'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:55.272699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f5a9165c8042209278cef6c5cc8386'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:55.273713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f5a9165c8042209278cef6c5cc8386'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:55.359614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f5a9165c8042209278cef6c5cc8386'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:55.391698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4b262f02-096b-4144-90ea-c779dbd69b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f5a9165c8042209278cef6c5cc8386'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:55.409066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1111/2203] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:36:54 2022] DELETE /identity/v3/users/44f5a9165c8042209278cef6c5cc8386 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:55.783410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:55.786210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:55.821694 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa5e8d-c8f1-4f52-b989-8027df9a540d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:55.899537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:55.901796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:55.901796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:55.901796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] PATH_INFO: `/v3/projects/c8125c6d3cd44e3abe7f5e4f10ed1527` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:55.910299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8125c6d3cd44e3abe7f5e4f10ed1527)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:55.912438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:56.551577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8125c6d3cd44e3abe7f5e4f10ed1527', 'request_id': 'req-b47257c7-2853-402f-b9e4-fce04a1f9a3a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:56.684059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8125c6d3cd44e3abe7f5e4f10ed1527', 'request_id': 'req-b47257c7-2853-402f-b9e4-fce04a1f9a3a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:56.697357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8125c6d3cd44e3abe7f5e4f10ed1527', 'request_id': 'req-b47257c7-2853-402f-b9e4-fce04a1f9a3a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:56.706432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] The token cache is being invalidate because project c8125c6d3cd44e3abe7f5e4f10ed1527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:36:56.706959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:56.707999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b47257c7-2853-402f-b9e4-fce04a1f9a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:36:56.710102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1093/2204] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:36:55 2022] DELETE /identity/v3/projects/c8125c6d3cd44e3abe7f5e4f10ed1527 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:56.714590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207403-4473-4a22-8f40-e93d6c7b7816 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:56.715508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207403-4473-4a22-8f40-e93d6c7b7816 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:56.715974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27207403-4473-4a22-8f40-e93d6c7b7816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:56.751953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-27207403-4473-4a22-8f40-e93d6c7b7816 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:56.753444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-27207403-4473-4a22-8f40-e93d6c7b7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:56.837641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1112/2205] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:36:56.849338 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86da1-c1c7-4378-92bc-d4a236aad292 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:56.849969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86da1-c1c7-4378-92bc-d4a236aad292 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:56.849969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86da1-c1c7-4378-92bc-d4a236aad292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:56.872228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-fee86da1-c1c7-4378-92bc-d4a236aad292 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:56.873468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-fee86da1-c1c7-4378-92bc-d4a236aad292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:56.882587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1094/2206] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:56.886430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27207403-4473-4a22-8f40-e93d6c7b7816 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:56.898804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27207403-4473-4a22-8f40-e93d6c7b7816 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:56.903929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:56.904617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:56.904973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:56.905320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:56.906255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:36:56.906630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:56.908568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:56.923535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1113/2207] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:36:56.928036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee86da1-c1c7-4378-92bc-d4a236aad292 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:56.939096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee86da1-c1c7-4378-92bc-d4a236aad292 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:56.945880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ead0f-4ab3-493d-8da0-cadf3e416e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:56.950564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ead0f-4ab3-493d-8da0-cadf3e416e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:56.950564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ead0f-4ab3-493d-8da0-cadf3e416e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:56.950564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ead0f-4ab3-493d-8da0-cadf3e416e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:56.950564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ead0f-4ab3-493d-8da0-cadf3e416e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:56.950564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ead0f-4ab3-493d-8da0-cadf3e416e97 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:57.064265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1095/2208] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:36:56 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:36:57.068637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:57.080424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9adb4-1320-4045-861a-f11a07517c6d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:57.174078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2505f-81f6-4d1d-ae61-1e233e031ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:57.175793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2505f-81f6-4d1d-ae61-1e233e031ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:57.176255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2505f-81f6-4d1d-ae61-1e233e031ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:57.176596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2505f-81f6-4d1d-ae61-1e233e031ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:57.177335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2505f-81f6-4d1d-ae61-1e233e031ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:57.179386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2505f-81f6-4d1d-ae61-1e233e031ea6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:57.278263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:57.285131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1114/2209] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:36:57 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:36:57.290549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ead0f-4ab3-493d-8da0-cadf3e416e97 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:57.306128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ead0f-4ab3-493d-8da0-cadf3e416e97 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:57.322705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408db6ca-d3cb-42e6-9f8a-d77c24ff76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:57.323434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db6ca-d3cb-42e6-9f8a-d77c24ff76ee admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:57.323785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db6ca-d3cb-42e6-9f8a-d77c24ff76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:57.324136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db6ca-d3cb-42e6-9f8a-d77c24ff76ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:57.324865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408db6ca-d3cb-42e6-9f8a-d77c24ff76ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:57.326666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408db6ca-d3cb-42e6-9f8a-d77c24ff76ee admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:57.340237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1096/2210] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:36:57.344634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2505f-81f6-4d1d-ae61-1e233e031ea6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:57.364675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2505f-81f6-4d1d-ae61-1e233e031ea6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:57.377673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1f6c8-bcc0-48d0-a751-269901f1e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:57.378776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f6c8-bcc0-48d0-a751-269901f1e6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:57.379333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f6c8-bcc0-48d0-a751-269901f1e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:57.380068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f6c8-bcc0-48d0-a751-269901f1e6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:57.381301 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1f6c8-bcc0-48d0-a751-269901f1e6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:57.385949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1f6c8-bcc0-48d0-a751-269901f1e6fa admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:57.416001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408db6ca-d3cb-42e6-9f8a-d77c24ff76ee admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:57.427013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1115/2211] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:36:57.433530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408db6ca-d3cb-42e6-9f8a-d77c24ff76ee admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:57.439174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8df90-9d51-438f-a055-78f3b5e03adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:57.440647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8df90-9d51-438f-a055-78f3b5e03adc admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:57.441048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8df90-9d51-438f-a055-78f3b5e03adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:57.441812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8df90-9d51-438f-a055-78f3b5e03adc admin admin] PATH_INFO: `/v3/projects/2a71ff2566de44d0a01d7b760643e59e/users/c803182ebb0c4393847bb1366fc99346/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:57.466075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8df90-9d51-438f-a055-78f3b5e03adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a71ff2566de44d0a01d7b760643e59e, user_id=c803182ebb0c4393847bb1366fc99346, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:57.469716 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8df90-9d51-438f-a055-78f3b5e03adc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:57.545465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1097/2212] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:36:57 2022] PUT /identity/v3/projects/2a71ff2566de44d0a01d7b760643e59e/users/c803182ebb0c4393847bb1366fc99346/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:57.556422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dd18d-0a97-4329-bee3-d8f14417a34b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:57.558114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dd18d-0a97-4329-bee3-d8f14417a34b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:57.558114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dd18d-0a97-4329-bee3-d8f14417a34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:57.592566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ba9dd18d-0a97-4329-bee3-d8f14417a34b None None] MFA Rules not processed for user `c803182ebb0c4393847bb1366fc99346`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:57.593857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ba9dd18d-0a97-4329-bee3-d8f14417a34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:57.696552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8df90-9d51-438f-a055-78f3b5e03adc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:57.702537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1116/2213] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:57.733337 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:57.791500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8df90-9d51-438f-a055-78f3b5e03adc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:57.807415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cc713-4c15-41ce-be52-1dab56ac5262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:57.809969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc713-4c15-41ce-be52-1dab56ac5262 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:57.809969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc713-4c15-41ce-be52-1dab56ac5262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:57.809969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc713-4c15-41ce-be52-1dab56ac5262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:57.809969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cc713-4c15-41ce-be52-1dab56ac5262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:57.812320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cc713-4c15-41ce-be52-1dab56ac5262 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:57.906628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1098/2214] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:36:57 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:36:57.907578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dd18d-0a97-4329-bee3-d8f14417a34b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:57.920708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dd18d-0a97-4329-bee3-d8f14417a34b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:57.996908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307bb33-7e1c-444e-a9fa-aea27c381a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:57.997940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307bb33-7e1c-444e-a9fa-aea27c381a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:57.998430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307bb33-7e1c-444e-a9fa-aea27c381a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:57.998890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307bb33-7e1c-444e-a9fa-aea27c381a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:57.999709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307bb33-7e1c-444e-a9fa-aea27c381a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:58.001750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307bb33-7e1c-444e-a9fa-aea27c381a0a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:58.108761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1117/2215] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:36:57 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:36:58.112918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cc713-4c15-41ce-be52-1dab56ac5262 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:58.125587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cc713-4c15-41ce-be52-1dab56ac5262 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:58.131007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e14f-28c1-420e-ab74-a8d13d2bcc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:58.131623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e14f-28c1-420e-ab74-a8d13d2bcc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:58.131955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e14f-28c1-420e-ab74-a8d13d2bcc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:58.132231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3e14f-28c1-420e-ab74-a8d13d2bcc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:58.132904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e14f-28c1-420e-ab74-a8d13d2bcc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:58.134544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3e14f-28c1-420e-ab74-a8d13d2bcc78 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:58.147143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1099/2216] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:36:58.151426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307bb33-7e1c-444e-a9fa-aea27c381a0a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:58.161858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307bb33-7e1c-444e-a9fa-aea27c381a0a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:58.166612 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e91fb7-e3b4-479c-8c4b-e74d9bbb0240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:58.167278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e91fb7-e3b4-479c-8c4b-e74d9bbb0240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:58.167560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e91fb7-e3b4-479c-8c4b-e74d9bbb0240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:58.167833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e91fb7-e3b4-479c-8c4b-e74d9bbb0240 admin admin] PATH_INFO: `/v3/projects/301b755382b74bffa8c8cb2b697d6dff/users/b6f4a211a29e479ca5f6ce7a40c0829d/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:58.187195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e91fb7-e3b4-479c-8c4b-e74d9bbb0240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301b755382b74bffa8c8cb2b697d6dff, user_id=b6f4a211a29e479ca5f6ce7a40c0829d, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:58.191242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e91fb7-e3b4-479c-8c4b-e74d9bbb0240 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:58.282543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1118/2217] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:36:58 2022] PUT /identity/v3/projects/301b755382b74bffa8c8cb2b697d6dff/users/b6f4a211a29e479ca5f6ce7a40c0829d/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:58.286852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e14f-28c1-420e-ab74-a8d13d2bcc78 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:58.297051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3e14f-28c1-420e-ab74-a8d13d2bcc78 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:58.400542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d3735-6df9-42b1-a6ce-e59f92b56985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:58.405862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d3735-6df9-42b1-a6ce-e59f92b56985 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:58.405862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d3735-6df9-42b1-a6ce-e59f92b56985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:58.405862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d3735-6df9-42b1-a6ce-e59f92b56985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:58.405862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d3735-6df9-42b1-a6ce-e59f92b56985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:58.405862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d3735-6df9-42b1-a6ce-e59f92b56985 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:58.417660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1100/2218] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:36:58.420868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e91fb7-e3b4-479c-8c4b-e74d9bbb0240 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:58.436146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e91fb7-e3b4-479c-8c4b-e74d9bbb0240 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:58.441818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:58.442542 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:58.442823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:58.443101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] PATH_INFO: `/v3/projects/301b755382b74bffa8c8cb2b697d6dff/users/b6f4a211a29e479ca5f6ce7a40c0829d/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:58.445090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301b755382b74bffa8c8cb2b697d6dff, user_id=b6f4a211a29e479ca5f6ce7a40c0829d, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:58.447853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:58.465275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1119/2219] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:36:58 2022] PUT /identity/v3/projects/301b755382b74bffa8c8cb2b697d6dff/users/b6f4a211a29e479ca5f6ce7a40c0829d/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:36:58.478748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec6bc-2eb4-4527-85cd-055b8e04329c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:58.479377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec6bc-2eb4-4527-85cd-055b8e04329c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:58.479725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ec6bc-2eb4-4527-85cd-055b8e04329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:58.525795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-905ec6bc-2eb4-4527-85cd-055b8e04329c None None] MFA Rules not processed for user `b6f4a211a29e479ca5f6ce7a40c0829d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:36:58.530771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-905ec6bc-2eb4-4527-85cd-055b8e04329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:58.644146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1101/2220] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:36:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:36:58.655702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:36:58.657573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:36:58.701444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:58.738995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23bb9-c910-4a34-8813-fbe06c9b7484 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:36:58.746341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:36:58.747267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:36:58.747552 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:36:58.747828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:36:58.812554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:36:58.814277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:36:58.827963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1120/2221] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:36:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:01.066438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5848b6-306d-48fb-97fa-d43bb0275cee None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:01.066958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5848b6-306d-48fb-97fa-d43bb0275cee None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:01.067072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5848b6-306d-48fb-97fa-d43bb0275cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:01.087872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-de5848b6-306d-48fb-97fa-d43bb0275cee None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:01.089644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-de5848b6-306d-48fb-97fa-d43bb0275cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:01.101807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:01.157550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1102/2222] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:01.187750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:01.189386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:01.275971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444962d-af98-4c92-8d2d-835af97a2ee5 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:01.282415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73b20-748b-452d-8861-3442604316a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:01.284060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73b20-748b-452d-8861-3442604316a7 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:01.284060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73b20-748b-452d-8861-3442604316a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:01.284060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73b20-748b-452d-8861-3442604316a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:01.296129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a73b20-748b-452d-8861-3442604316a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:01.297850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a73b20-748b-452d-8861-3442604316a7 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:01.309415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1121/2223] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:04.866424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5848b6-306d-48fb-97fa-d43bb0275cee None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:04.876510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5848b6-306d-48fb-97fa-d43bb0275cee None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:04.880253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:04.881083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:04.881533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:04.881998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:04.892319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:04.894086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:04.918562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1103/2224] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:05.470842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55035f-3784-4c3d-b52d-6e7c1b3bf553 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:05.473408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55035f-3784-4c3d-b52d-6e7c1b3bf553 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:05.473408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55035f-3784-4c3d-b52d-6e7c1b3bf553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:05.490233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4b55035f-3784-4c3d-b52d-6e7c1b3bf553 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:05.491477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4b55035f-3784-4c3d-b52d-6e7c1b3bf553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:05.567106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1122/2225] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:05.579094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:05.594713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:05.665727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a1fcc-a869-4cf3-bba1-8d62e447c05d service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:05.674404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b282c3-2e88-4421-b3ed-4832cb9f7f0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:05.675167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b282c3-2e88-4421-b3ed-4832cb9f7f0a service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:05.675678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b282c3-2e88-4421-b3ed-4832cb9f7f0a service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:05.676142 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b282c3-2e88-4421-b3ed-4832cb9f7f0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:05.692581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b282c3-2e88-4421-b3ed-4832cb9f7f0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:05.692686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b282c3-2e88-4421-b3ed-4832cb9f7f0a service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:05.710349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1104/2226] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:37:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:37:06.618952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f7418-34db-466a-8110-c2b953344762 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:06.618952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f7418-34db-466a-8110-c2b953344762 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:06.618952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f7418-34db-466a-8110-c2b953344762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:06.631891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-fa0f7418-34db-466a-8110-c2b953344762 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:06.633093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fa0f7418-34db-466a-8110-c2b953344762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:06.640465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1123/2227] 10.222.0.61 () {58 vars in 967 bytes} [Tue Aug 23 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:06.668985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b282c3-2e88-4421-b3ed-4832cb9f7f0a service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:06.678402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b282c3-2e88-4421-b3ed-4832cb9f7f0a service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:06.683588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0b5f-61b1-4d99-b2d3-2e397df0d3b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:06.684179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0b5f-61b1-4d99-b2d3-2e397df0d3b2 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:06.684447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0b5f-61b1-4d99-b2d3-2e397df0d3b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:06.684728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0b5f-61b1-4d99-b2d3-2e397df0d3b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:06.694054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0b5f-61b1-4d99-b2d3-2e397df0d3b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:06.696678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0b5f-61b1-4d99-b2d3-2e397df0d3b2 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:06.703720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1105/2228] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:37:07.377951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5d885-1bc7-4b1f-944b-d4c06e0010b5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:07.378244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5d885-1bc7-4b1f-944b-d4c06e0010b5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:07.378522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5d885-1bc7-4b1f-944b-d4c06e0010b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:07.398313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-02c5d885-1bc7-4b1f-944b-d4c06e0010b5 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:07.399531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-02c5d885-1bc7-4b1f-944b-d4c06e0010b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:07.406641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1124/2229] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:07.419774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0b5f-61b1-4d99-b2d3-2e397df0d3b2 service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:07.430359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0b5f-61b1-4d99-b2d3-2e397df0d3b2 service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:07.435402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:07.435989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:07.436942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:07.437213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:07.445683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:07.447374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:07.455780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1106/2230] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:37:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 16:37:07.838941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae890-d92c-45a6-a87e-8f5a5bf752d9 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:07.839406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae890-d92c-45a6-a87e-8f5a5bf752d9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:07.839493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae890-d92c-45a6-a87e-8f5a5bf752d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:07.855827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:07.868637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-425ae890-d92c-45a6-a87e-8f5a5bf752d9 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:07.870063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-425ae890-d92c-45a6-a87e-8f5a5bf752d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:07.879206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1125/2231] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:07.905870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:07.907829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:07.926169 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db744c8-fb41-4be0-9527-becb6c49ef3b service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:07.933750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c515ccc-a088-4668-9ac0-47f1e93ee65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:07.934627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515ccc-a088-4668-9ac0-47f1e93ee65c service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:07.935125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515ccc-a088-4668-9ac0-47f1e93ee65c service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:07.935450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c515ccc-a088-4668-9ac0-47f1e93ee65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:07.957456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c515ccc-a088-4668-9ac0-47f1e93ee65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:07.959090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c515ccc-a088-4668-9ac0-47f1e93ee65c service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:07.982077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1107/2232] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:08.103708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5315d-6152-4c35-8607-6189b1ab8b2f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:08.104392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5315d-6152-4c35-8607-6189b1ab8b2f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:08.104978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5315d-6152-4c35-8607-6189b1ab8b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:08.130630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-daf5315d-6152-4c35-8607-6189b1ab8b2f None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:08.131885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-daf5315d-6152-4c35-8607-6189b1ab8b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:08.140125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1126/2233] 10.222.0.61 () {58 vars in 967 bytes} [Tue Aug 23 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:37:08.155596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c515ccc-a088-4668-9ac0-47f1e93ee65c service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:08.167504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c515ccc-a088-4668-9ac0-47f1e93ee65c service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:08.173263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446e94e-1631-435b-938d-cf13ca5c149b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:08.174196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e94e-1631-435b-938d-cf13ca5c149b service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:08.175202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e94e-1631-435b-938d-cf13ca5c149b service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:08.175666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e94e-1631-435b-938d-cf13ca5c149b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:08.189527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446e94e-1631-435b-938d-cf13ca5c149b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:08.192800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446e94e-1631-435b-938d-cf13ca5c149b service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:08.203833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1108/2234] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:37:11.216154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5315d-6152-4c35-8607-6189b1ab8b2f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:11.217561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-daf5315d-6152-4c35-8607-6189b1ab8b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:11.232198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5315d-6152-4c35-8607-6189b1ab8b2f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:11.236698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:11.237421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:11.237731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:11.238528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] PATH_INFO: `/v3/users/294684f6e382400cba20ff999b1b7e67` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:11.239756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=294684f6e382400cba20ff999b1b7e67)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:11.241710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:11.422094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294684f6e382400cba20ff999b1b7e67'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:11.422748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294684f6e382400cba20ff999b1b7e67'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:11.423349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294684f6e382400cba20ff999b1b7e67'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:11.486688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ab97a-580f-449e-9dfa-16da09ea9c68 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:11.487293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ab97a-580f-449e-9dfa-16da09ea9c68 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:11.487293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ab97a-580f-449e-9dfa-16da09ea9c68 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:11.489308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1109/2235] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:37:11.496029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068c895-674b-469d-be34-5dc3506bb7e3 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:11.496367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068c895-674b-469d-be34-5dc3506bb7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:11.496839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068c895-674b-469d-be34-5dc3506bb7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:11.501400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294684f6e382400cba20ff999b1b7e67'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:11.529877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ee42302-2a6c-4dcc-83cc-c2656f1e85bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294684f6e382400cba20ff999b1b7e67'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:11.538413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b068c895-674b-469d-be34-5dc3506bb7e3 None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:11.539649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b068c895-674b-469d-be34-5dc3506bb7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:11.550237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1127/2236] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:37:11 2022] DELETE /identity/v3/users/294684f6e382400cba20ff999b1b7e67 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:11.555262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cbaa-a519-46e1-a54a-ee2ea13b1817 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:11.557477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cbaa-a519-46e1-a54a-ee2ea13b1817 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:11.557477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6cbaa-a519-46e1-a54a-ee2ea13b1817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:11.560463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1110/2237] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:37:11.574869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068c895-674b-469d-be34-5dc3506bb7e3 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:11.576681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b068c895-674b-469d-be34-5dc3506bb7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:11.582763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-bfe6cbaa-a519-46e1-a54a-ee2ea13b1817 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:11.584036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bfe6cbaa-a519-46e1-a54a-ee2ea13b1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:11.625288 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:11.645817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068c895-674b-469d-be34-5dc3506bb7e3 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:11.657295 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1128/2238] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:11.668784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6cbaa-a519-46e1-a54a-ee2ea13b1817 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:11.670737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bfe6cbaa-a519-46e1-a54a-ee2ea13b1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:11.696635 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f9747-d297-48b1-9bb8-dd9e1e353fc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8070d1891844da59196d00ebbdff832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:11.697240 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9747-d297-48b1-9bb8-dd9e1e353fc5 service glance] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:11.697540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9747-d297-48b1-9bb8-dd9e1e353fc5 service glance] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:11.698427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f9747-d297-48b1-9bb8-dd9e1e353fc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:11.732978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6cbaa-a519-46e1-a54a-ee2ea13b1817 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:11.736640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ea98c-8440-42c4-b855-fdd7b5b271d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:11.737240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ea98c-8440-42c4-b855-fdd7b5b271d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:11.737562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ea98c-8440-42c4-b855-fdd7b5b271d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:11.737952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ea98c-8440-42c4-b855-fdd7b5b271d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:11.747945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ea98c-8440-42c4-b855-fdd7b5b271d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:11.749469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ea98c-8440-42c4-b855-fdd7b5b271d4 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:11.760323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1129/2239] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:37:11.788887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9747-d297-48b1-9bb8-dd9e1e353fc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:11.788887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f9747-d297-48b1-9bb8-dd9e1e353fc5 service glance] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:11.798743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1111/2240] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:37:12.015590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bea53-0a9e-4f13-b99d-cf833e00a862 None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.015884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bea53-0a9e-4f13-b99d-cf833e00a862 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.016164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bea53-0a9e-4f13-b99d-cf833e00a862 None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.017964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1130/2241] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:37:12.022944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57ffa4-c881-416f-96b3-c1250046141e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.024708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57ffa4-c881-416f-96b3-c1250046141e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.024984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57ffa4-c881-416f-96b3-c1250046141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.040231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bea53-0a9e-4f13-b99d-cf833e00a862 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:12.042122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d81bea53-0a9e-4f13-b99d-cf833e00a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.046588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1a57ffa4-c881-416f-96b3-c1250046141e None None] MFA Rules not processed for user `3d5b15e9f0414836b3611a8ff6085b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:12.048011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1a57ffa4-c881-416f-96b3-c1250046141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.056070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1112/2242] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:12.061441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:12.073802 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bea53-0a9e-4f13-b99d-cf833e00a862 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:12.073996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57ffa4-c881-416f-96b3-c1250046141e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:12.075498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1a57ffa4-c881-416f-96b3-c1250046141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.079907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:12.080966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.081354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.081943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] PATH_INFO: `/v3/projects/94512035a58945b58b1ee99b224b2666` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.083140 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94512035a58945b58b1ee99b224b2666)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:12.085109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:12.086660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57ffa4-c881-416f-96b3-c1250046141e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:12.090417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2e167-b2d8-47d7-9923-41617ebc2931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:12.091016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e167-b2d8-47d7-9923-41617ebc2931 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.093770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e167-b2d8-47d7-9923-41617ebc2931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.093770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e167-b2d8-47d7-9923-41617ebc2931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.098992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2e167-b2d8-47d7-9923-41617ebc2931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:12.100423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2e167-b2d8-47d7-9923-41617ebc2931 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:12.108759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1113/2243] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:12.201497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94512035a58945b58b1ee99b224b2666', 'request_id': 'req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.206875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628d25-b1dc-4535-82f9-52b4060024d6 None None] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.206875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628d25-b1dc-4535-82f9-52b4060024d6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.206875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628d25-b1dc-4535-82f9-52b4060024d6 None None] PATH_INFO: `/` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.207858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1114/2244] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:37:12.208326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94512035a58945b58b1ee99b224b2666', 'request_id': 'req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.213451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b0d2-6afb-46f9-9940-77cab8a64d1d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.213753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b0d2-6afb-46f9-9940-77cab8a64d1d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.214021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b0d2-6afb-46f9-9940-77cab8a64d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.234500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-dad6b0d2-6afb-46f9-9940-77cab8a64d1d None None] MFA Rules not processed for user `33ac116b19864bd694ca089dd5f7e010`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:12.235858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dad6b0d2-6afb-46f9-9940-77cab8a64d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.278395 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94512035a58945b58b1ee99b224b2666', 'request_id': 'req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.289971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] The token cache is being invalidate because project 94512035a58945b58b1ee99b224b2666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:37:12.290351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.291052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3cd2eff9-45cf-4e1f-bd76-10979d9ae42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.292792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1131/2245] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:37:12 2022] DELETE /identity/v3/projects/94512035a58945b58b1ee99b224b2666 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:37:12.294270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b126-adea-4bd4-b544-4746de4af06f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.294563 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b126-adea-4bd4-b544-4746de4af06f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.294844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b126-adea-4bd4-b544-4746de4af06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.321525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1115/2246] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:12.337235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6b0d2-6afb-46f9-9940-77cab8a64d1d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:12.339024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-9fa6b126-adea-4bd4-b544-4746de4af06f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:12.339265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dad6b0d2-6afb-46f9-9940-77cab8a64d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.340689 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9fa6b126-adea-4bd4-b544-4746de4af06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.346715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:12.419044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1132/2247] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:12.420515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6b126-adea-4bd4-b544-4746de4af06f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:12.422177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9fa6b126-adea-4bd4-b544-4746de4af06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.434366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6b0d2-6afb-46f9-9940-77cab8a64d1d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:12.440411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:12.441794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.442269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.442567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] PATH_INFO: `/v3/users/c803182ebb0c4393847bb1366fc99346` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.444043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c803182ebb0c4393847bb1366fc99346)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:12.446236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:12.510597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6b126-adea-4bd4-b544-4746de4af06f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:12.514272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:12.514884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.515169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.515456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.526649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:12.528122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:12.539525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1133/2248] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:12.540334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:12.541705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.556233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c393c41-05bd-4fb9-aa4b-dc767d609606 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:12.562084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc42621-7b62-4d7f-bd7d-a1f3146b15c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:12.562671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc42621-7b62-4d7f-bd7d-a1f3146b15c7 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.562951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc42621-7b62-4d7f-bd7d-a1f3146b15c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.563253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc42621-7b62-4d7f-bd7d-a1f3146b15c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.571557 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc42621-7b62-4d7f-bd7d-a1f3146b15c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:12.573139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc42621-7b62-4d7f-bd7d-a1f3146b15c7 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:12.584370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1134/2249] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:12.637110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c803182ebb0c4393847bb1366fc99346'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.645722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c803182ebb0c4393847bb1366fc99346'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.646708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c803182ebb0c4393847bb1366fc99346'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.647509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c803182ebb0c4393847bb1366fc99346'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.661359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c803182ebb0c4393847bb1366fc99346'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:12.754160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1116/2250] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:37:12 2022] DELETE /identity/v3/users/c803182ebb0c4393847bb1366fc99346 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:12.757500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559523da-b280-4492-bb30-dd6d0439f9b1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.757910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559523da-b280-4492-bb30-dd6d0439f9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.758126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559523da-b280-4492-bb30-dd6d0439f9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.777801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-559523da-b280-4492-bb30-dd6d0439f9b1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:12.779113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-559523da-b280-4492-bb30-dd6d0439f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.792299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:12.860524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1135/2251] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:37:12.870264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:12.871692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:12.935006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5832d-b0d6-43ed-8f09-59d82a386f64 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:12.938681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa41b8-95d6-4361-a814-ea9a1eaed7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:12.939293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa41b8-95d6-4361-a814-ea9a1eaed7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:12.939583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa41b8-95d6-4361-a814-ea9a1eaed7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:12.939862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa41b8-95d6-4361-a814-ea9a1eaed7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:12.949479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa41b8-95d6-4361-a814-ea9a1eaed7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:12.950970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa41b8-95d6-4361-a814-ea9a1eaed7f0 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:12.960629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1117/2252] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:13.403904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559523da-b280-4492-bb30-dd6d0439f9b1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:13.407992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-559523da-b280-4492-bb30-dd6d0439f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:13.419958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559523da-b280-4492-bb30-dd6d0439f9b1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:13.424602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:13.425844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:13.426356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:13.426587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] PATH_INFO: `/v3/projects/2a71ff2566de44d0a01d7b760643e59e` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:13.427728 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a71ff2566de44d0a01d7b760643e59e)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:13.429665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:13.537945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a71ff2566de44d0a01d7b760643e59e', 'request_id': 'req-65d81d98-ec13-40a3-9636-3b7a4026c7f9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.544029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a71ff2566de44d0a01d7b760643e59e', 'request_id': 'req-65d81d98-ec13-40a3-9636-3b7a4026c7f9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.644810 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a71ff2566de44d0a01d7b760643e59e', 'request_id': 'req-65d81d98-ec13-40a3-9636-3b7a4026c7f9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.655598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] The token cache is being invalidate because project 2a71ff2566de44d0a01d7b760643e59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:37:13.655831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.656449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.657954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1136/2253] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:37:13 2022] DELETE /identity/v3/projects/2a71ff2566de44d0a01d7b760643e59e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:13.661994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa41b8-95d6-4361-a814-ea9a1eaed7f0 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:13.671379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa41b8-95d6-4361-a814-ea9a1eaed7f0 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:13.695280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:13.726824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:13.729175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:13.729175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:13.729175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] PATH_INFO: `/v3/users/b6f4a211a29e479ca5f6ce7a40c0829d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:13.729175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f4a211a29e479ca5f6ce7a40c0829d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:13.731008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:13.927159 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f4a211a29e479ca5f6ce7a40c0829d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.934644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f4a211a29e479ca5f6ce7a40c0829d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.935336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f4a211a29e479ca5f6ce7a40c0829d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.935937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f4a211a29e479ca5f6ce7a40c0829d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:13.952134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-70b2a381-e1e8-4ad1-91e9-bd6cd8ad7cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f4a211a29e479ca5f6ce7a40c0829d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:14.013727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1118/2254] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:37:13 2022] DELETE /identity/v3/users/b6f4a211a29e479ca5f6ce7a40c0829d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:14.582224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:14.583688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:14.596600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d81d98-ec13-40a3-9636-3b7a4026c7f9 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:14.684134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:14.684850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:14.685311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:14.685516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] PATH_INFO: `/v3/projects/301b755382b74bffa8c8cb2b697d6dff` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:14.686826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301b755382b74bffa8c8cb2b697d6dff)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:14.688991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:14.823872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:14.827690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301b755382b74bffa8c8cb2b697d6dff', 'request_id': 'req-812ea961-5534-4242-a21b-8b85f0a8d977'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:14.834492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301b755382b74bffa8c8cb2b697d6dff', 'request_id': 'req-812ea961-5534-4242-a21b-8b85f0a8d977'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:14.924193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301b755382b74bffa8c8cb2b697d6dff', 'request_id': 'req-812ea961-5534-4242-a21b-8b85f0a8d977'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:14.935314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] The token cache is being invalidate because project 301b755382b74bffa8c8cb2b697d6dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:37:14.935614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:14.936242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-812ea961-5534-4242-a21b-8b85f0a8d977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:14.937756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1137/2255] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:37:14 2022] DELETE /identity/v3/projects/301b755382b74bffa8c8cb2b697d6dff => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:14.943838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff1b5-609f-4430-954e-c67c61b81ee1 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:14.944307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff1b5-609f-4430-954e-c67c61b81ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:14.944307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aff1b5-609f-4430-954e-c67c61b81ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:14.964812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c4aff1b5-609f-4430-954e-c67c61b81ee1 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:14.966033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c4aff1b5-609f-4430-954e-c67c61b81ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:15.033769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1119/2256] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:37:15.045436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb727-eb1e-4161-805d-7b6fac83e7a7 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.045656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb727-eb1e-4161-805d-7b6fac83e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.046035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb727-eb1e-4161-805d-7b6fac83e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.066936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-9b4fb727-eb1e-4161-805d-7b6fac83e7a7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:15.068271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9b4fb727-eb1e-4161-805d-7b6fac83e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:15.076779 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1138/2257] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:15.081339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aff1b5-609f-4430-954e-c67c61b81ee1 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:15.091866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aff1b5-609f-4430-954e-c67c61b81ee1 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:15.096607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:15.097303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.098113 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.102251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.102251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:37:15.102251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:15.102251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:15.113356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1120/2258] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:37:15.121554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb727-eb1e-4161-805d-7b6fac83e7a7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:15.131650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb727-eb1e-4161-805d-7b6fac83e7a7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:15.136492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72860bb4-0848-4ffb-9e3a-71c4d4bd854f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:15.137096 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860bb4-0848-4ffb-9e3a-71c4d4bd854f admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.137685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860bb4-0848-4ffb-9e3a-71c4d4bd854f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.137961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72860bb4-0848-4ffb-9e3a-71c4d4bd854f admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.138756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72860bb4-0848-4ffb-9e3a-71c4d4bd854f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:15.140882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72860bb4-0848-4ffb-9e3a-71c4d4bd854f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:15.325845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1139/2259] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:37:15 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:37:15.330081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:15.340341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bcd29-dcf9-4737-aec4-10270611412b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:15.374390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:15.403751 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f744b-48f6-4634-8197-f590a32ad2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:15.404355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f744b-48f6-4634-8197-f590a32ad2fd admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.404633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f744b-48f6-4634-8197-f590a32ad2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.404917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f744b-48f6-4634-8197-f590a32ad2fd admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.405534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f744b-48f6-4634-8197-f590a32ad2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:15.407520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f744b-48f6-4634-8197-f590a32ad2fd admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:15.472392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bccccb-44f5-407e-b8c3-dcbaf5ed63ee None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.472676 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bccccb-44f5-407e-b8c3-dcbaf5ed63ee None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.472949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bccccb-44f5-407e-b8c3-dcbaf5ed63ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.489106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1121/2260] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:37:15 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:37:15.492359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-96bccccb-44f5-407e-b8c3-dcbaf5ed63ee None None] MFA Rules not processed for user `21f47cbaa3084658a6b60da569419ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:15.493561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-96bccccb-44f5-407e-b8c3-dcbaf5ed63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:15.494611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f744b-48f6-4634-8197-f590a32ad2fd admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:15.505582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f744b-48f6-4634-8197-f590a32ad2fd admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:15.511369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1331c4-cf52-4a25-b564-dbbc3ee5a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:15.514957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1331c4-cf52-4a25-b564-dbbc3ee5a46d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.514957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1331c4-cf52-4a25-b564-dbbc3ee5a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.514957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1331c4-cf52-4a25-b564-dbbc3ee5a46d admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.514957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1331c4-cf52-4a25-b564-dbbc3ee5a46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:15.514957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1331c4-cf52-4a25-b564-dbbc3ee5a46d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:15.525117 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1122/2261] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:37:15.529881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1331c4-cf52-4a25-b564-dbbc3ee5a46d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:15.540075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1331c4-cf52-4a25-b564-dbbc3ee5a46d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:15.545354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4c39d-e5bf-4102-bcac-36340b2b26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:15.546075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4c39d-e5bf-4102-bcac-36340b2b26a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.546426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4c39d-e5bf-4102-bcac-36340b2b26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.546799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4c39d-e5bf-4102-bcac-36340b2b26a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.547497 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4c39d-e5bf-4102-bcac-36340b2b26a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:15.549125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4c39d-e5bf-4102-bcac-36340b2b26a9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:15.554565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1140/2262] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:37:15.562919 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1123/2263] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:37:15.564080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bccccb-44f5-407e-b8c3-dcbaf5ed63ee None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:15.581860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bccccb-44f5-407e-b8c3-dcbaf5ed63ee None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:15.583276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:15.584012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.584404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.584741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] PATH_INFO: `/v3/projects/fd783abe2fc0420aac3603b639051085/users/a1c563b9e11e4f98abf65c844fc1282c/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.601382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd783abe2fc0420aac3603b639051085, user_id=a1c563b9e11e4f98abf65c844fc1282c, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:15.605349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:15.684951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1141/2264] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:37:15 2022] PUT /identity/v3/projects/fd783abe2fc0420aac3603b639051085/users/a1c563b9e11e4f98abf65c844fc1282c/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:37:15.696681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382e467-e09b-49a4-af7d-76329d34713c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.696972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382e467-e09b-49a4-af7d-76329d34713c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.697251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382e467-e09b-49a4-af7d-76329d34713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.726787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0382e467-e09b-49a4-af7d-76329d34713c None None] MFA Rules not processed for user `a1c563b9e11e4f98abf65c844fc1282c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:15.727884 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0382e467-e09b-49a4-af7d-76329d34713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:15.795105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1124/2265] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:15.807233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:15.809076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:15.869729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830401b9-2a96-49aa-9e64-5b3e7a1df6ef admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:15.873301 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc0d0e-d22f-46bf-9879-e6bab2863593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:15.873978 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0d0e-d22f-46bf-9879-e6bab2863593 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:15.874256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0d0e-d22f-46bf-9879-e6bab2863593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:15.874526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc0d0e-d22f-46bf-9879-e6bab2863593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:15.884471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc0d0e-d22f-46bf-9879-e6bab2863593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:15.885699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc0d0e-d22f-46bf-9879-e6bab2863593 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:15.895272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1142/2266] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:19.143611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382e467-e09b-49a4-af7d-76329d34713c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:19.204627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382e467-e09b-49a4-af7d-76329d34713c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:19.209620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:19.210261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:19.210542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:19.210816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] PATH_INFO: `/v3/users/a1c563b9e11e4f98abf65c844fc1282c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:19.211941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c563b9e11e4f98abf65c844fc1282c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:19.213990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:19.369767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:19.382065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c563b9e11e4f98abf65c844fc1282c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:19.389058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c563b9e11e4f98abf65c844fc1282c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:19.389797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c563b9e11e4f98abf65c844fc1282c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:19.390419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c563b9e11e4f98abf65c844fc1282c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:19.403252 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c563b9e11e4f98abf65c844fc1282c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:19.513248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1125/2267] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:37:19 2022] DELETE /identity/v3/users/a1c563b9e11e4f98abf65c844fc1282c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:19.518184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2733-1d39-4f1f-a5b1-42c23f36732e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:19.518693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2733-1d39-4f1f-a5b1-42c23f36732e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:19.522430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2733-1d39-4f1f-a5b1-42c23f36732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:19.537959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-beec2733-1d39-4f1f-a5b1-42c23f36732e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:19.539173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-beec2733-1d39-4f1f-a5b1-42c23f36732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:19.560015 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:19.600008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1143/2268] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:19.609642 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:19.611008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:19.668889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a573f-5e9b-426a-8385-ee7501843423 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:19.672610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d988440-513f-4ff2-83b8-63aa89016e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:19.673208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988440-513f-4ff2-83b8-63aa89016e60 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:19.673491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988440-513f-4ff2-83b8-63aa89016e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:19.673799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d988440-513f-4ff2-83b8-63aa89016e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:19.683214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d988440-513f-4ff2-83b8-63aa89016e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:19.684643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d988440-513f-4ff2-83b8-63aa89016e60 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:19.694618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1126/2269] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:20.143638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec2733-1d39-4f1f-a5b1-42c23f36732e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:20.145452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-beec2733-1d39-4f1f-a5b1-42c23f36732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:20.158865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec2733-1d39-4f1f-a5b1-42c23f36732e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:20.164754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:20.165503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.165876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.166224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] PATH_INFO: `/v3/projects/fd783abe2fc0420aac3603b639051085` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.167973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd783abe2fc0420aac3603b639051085)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:20.174076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:20.336064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd783abe2fc0420aac3603b639051085', 'request_id': 'req-8f36b307-5e85-4779-8b09-43f10ea5edc5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:20.342127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd783abe2fc0420aac3603b639051085', 'request_id': 'req-8f36b307-5e85-4779-8b09-43f10ea5edc5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:20.415852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd783abe2fc0420aac3603b639051085', 'request_id': 'req-8f36b307-5e85-4779-8b09-43f10ea5edc5'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:20.426973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] The token cache is being invalidate because project fd783abe2fc0420aac3603b639051085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:37:20.427260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:20.433180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8f36b307-5e85-4779-8b09-43f10ea5edc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:20.433180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1144/2270] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:37:20 2022] DELETE /identity/v3/projects/fd783abe2fc0420aac3603b639051085 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:20.434466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c3b0d-2eac-4670-a862-acf121597c3b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.434942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c3b0d-2eac-4670-a862-acf121597c3b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.435052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c3b0d-2eac-4670-a862-acf121597c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.454162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ee7c3b0d-2eac-4670-a862-acf121597c3b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:20.455343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ee7c3b0d-2eac-4670-a862-acf121597c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:20.512392 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1127/2271] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:20.521981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc0d3d-1c40-495c-8ab4-3a86e4720901 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.522466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc0d3d-1c40-495c-8ab4-3a86e4720901 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.522587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc0d3d-1c40-495c-8ab4-3a86e4720901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.543298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-17bc0d3d-1c40-495c-8ab4-3a86e4720901 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:20.544534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-17bc0d3d-1c40-495c-8ab4-3a86e4720901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:20.552443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1145/2272] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:20.556649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c3b0d-2eac-4670-a862-acf121597c3b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:20.566283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c3b0d-2eac-4670-a862-acf121597c3b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:20.570813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:20.571406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.571685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.571957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.572603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:37:20.572903 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:20.574545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:20.586950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1128/2273] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:37:20.590915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc0d3d-1c40-495c-8ab4-3a86e4720901 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:20.600776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc0d3d-1c40-495c-8ab4-3a86e4720901 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:20.605461 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58a1b-c7de-46ca-9bbc-039974f6102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:20.606091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58a1b-c7de-46ca-9bbc-039974f6102a admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.606371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58a1b-c7de-46ca-9bbc-039974f6102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.606642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58a1b-c7de-46ca-9bbc-039974f6102a admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.607271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb58a1b-c7de-46ca-9bbc-039974f6102a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:20.609169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb58a1b-c7de-46ca-9bbc-039974f6102a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:20.709834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1146/2274] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:37:20 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:37:20.714191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:20.725046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e710e6-e21c-4a33-b701-c84d7ee3fc7d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:20.764454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:20.783358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895606-a42f-4b20-b0d7-f1ac8109309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:20.783960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895606-a42f-4b20-b0d7-f1ac8109309b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.784239 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895606-a42f-4b20-b0d7-f1ac8109309b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.784507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea895606-a42f-4b20-b0d7-f1ac8109309b admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.785775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895606-a42f-4b20-b0d7-f1ac8109309b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:20.787687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea895606-a42f-4b20-b0d7-f1ac8109309b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:20.894017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1129/2275] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:37:20 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:37:20.896075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58a1b-c7de-46ca-9bbc-039974f6102a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:20.906963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58a1b-c7de-46ca-9bbc-039974f6102a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:20.911681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c111a6-0e2a-45a9-98e9-6a701923b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:20.912304 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c111a6-0e2a-45a9-98e9-6a701923b450 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.912579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c111a6-0e2a-45a9-98e9-6a701923b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.916631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c111a6-0e2a-45a9-98e9-6a701923b450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.916631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c111a6-0e2a-45a9-98e9-6a701923b450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:20.916631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c111a6-0e2a-45a9-98e9-6a701923b450 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:20.928525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1147/2276] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:37:20.930333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895606-a42f-4b20-b0d7-f1ac8109309b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:20.940154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea895606-a42f-4b20-b0d7-f1ac8109309b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:20.945515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aa48b-1f4b-44d5-bc09-c67c87b21027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:20.946148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa48b-1f4b-44d5-bc09-c67c87b21027 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.946435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa48b-1f4b-44d5-bc09-c67c87b21027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.946710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aa48b-1f4b-44d5-bc09-c67c87b21027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.947358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aa48b-1f4b-44d5-bc09-c67c87b21027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:20.948942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aa48b-1f4b-44d5-bc09-c67c87b21027 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:20.960619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1130/2277] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:37:20.964752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c111a6-0e2a-45a9-98e9-6a701923b450 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:20.975055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c111a6-0e2a-45a9-98e9-6a701923b450 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:20.979781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:20.980435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:20.980721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:20.980999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] PATH_INFO: `/v3/projects/f6cdf4b87c844a309e203f969f92709f/users/65b2dc619e4649afb20503dbd0bca0dc/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:20.995280 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cdf4b87c844a309e203f969f92709f, user_id=65b2dc619e4649afb20503dbd0bca0dc, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:20.997951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:21.102277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1148/2278] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:37:20 2022] PUT /identity/v3/projects/f6cdf4b87c844a309e203f969f92709f/users/65b2dc619e4649afb20503dbd0bca0dc/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:21.112670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462723-b070-4e80-a660-d51ac3a95518 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:21.112999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462723-b070-4e80-a660-d51ac3a95518 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:21.113327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462723-b070-4e80-a660-d51ac3a95518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:21.141040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f4462723-b070-4e80-a660-d51ac3a95518 None None] MFA Rules not processed for user `65b2dc619e4649afb20503dbd0bca0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:21.142567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f4462723-b070-4e80-a660-d51ac3a95518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:21.206467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1131/2279] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:21.217021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:21.218761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:21.273021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:21.278357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc656e-1c5b-4d13-bd54-dff25ba15b13 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:21.281997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:21.282603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:21.282909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:21.283301 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:21.292190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:21.293694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:21.302588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1149/2280] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:23.869696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e90a1-74b3-4b0c-89bb-a10d8a2d2998 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:23.870199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e90a1-74b3-4b0c-89bb-a10d8a2d2998 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:23.870321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e90a1-74b3-4b0c-89bb-a10d8a2d2998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:23.890486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cf1e90a1-74b3-4b0c-89bb-a10d8a2d2998 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:23.891673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cf1e90a1-74b3-4b0c-89bb-a10d8a2d2998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:23.946860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1132/2281] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:37:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:23.959166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:23.960580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:24.034803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eab738-1624-4a64-b001-2efde5b2be9f service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:24.040278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd79eb-b01e-4caf-b50d-54e5ae210096 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:24.040906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd79eb-b01e-4caf-b50d-54e5ae210096 service swift] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:24.041221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd79eb-b01e-4caf-b50d-54e5ae210096 service swift] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:24.041457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd79eb-b01e-4caf-b50d-54e5ae210096 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:24.050895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd79eb-b01e-4caf-b50d-54e5ae210096 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:24.053131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd79eb-b01e-4caf-b50d-54e5ae210096 service swift] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:24.061856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1150/2282] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:37:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:37:33.749394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e90a1-74b3-4b0c-89bb-a10d8a2d2998 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:33.750830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cf1e90a1-74b3-4b0c-89bb-a10d8a2d2998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:33.837344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:33.859295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e90a1-74b3-4b0c-89bb-a10d8a2d2998 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:33.865692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b35f-aaf4-4b47-8c1d-07a66eb7b3bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:33.866324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b35f-aaf4-4b47-8c1d-07a66eb7b3bd service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:33.866608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b35f-aaf4-4b47-8c1d-07a66eb7b3bd service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:33.866879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b35f-aaf4-4b47-8c1d-07a66eb7b3bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:33.868666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0918b35f-aaf4-4b47-8c1d-07a66eb7b3bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:33.881230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b35f-aaf4-4b47-8c1d-07a66eb7b3bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:33.882789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b35f-aaf4-4b47-8c1d-07a66eb7b3bd service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:33.893865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1133/2283] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:34.058758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=37 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:34.314456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd79eb-b01e-4caf-b50d-54e5ae210096 service swift] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:34.377441 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd79eb-b01e-4caf-b50d-54e5ae210096 service swift] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:34.381958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:34.382595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:34.382875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:34.383169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] PATH_INFO: `/v3/users/65b2dc619e4649afb20503dbd0bca0dc` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:34.384412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b2dc619e4649afb20503dbd0bca0dc)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:34.386527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:34.619134 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b2dc619e4649afb20503dbd0bca0dc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:34.619793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b2dc619e4649afb20503dbd0bca0dc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:34.620406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b2dc619e4649afb20503dbd0bca0dc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:34.687686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b2dc619e4649afb20503dbd0bca0dc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:34.700054 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b2dc619e4649afb20503dbd0bca0dc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:34.712951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1151/2284] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:37:34 2022] DELETE /identity/v3/users/65b2dc619e4649afb20503dbd0bca0dc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:37:34.717434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032fe9-172d-4296-831a-177c1e8dd012 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:34.717756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032fe9-172d-4296-831a-177c1e8dd012 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:34.718032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032fe9-172d-4296-831a-177c1e8dd012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:34.736866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d9032fe9-172d-4296-831a-177c1e8dd012 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:34.738062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9032fe9-172d-4296-831a-177c1e8dd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:34.795702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1134/2285] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:34.805444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:34.806865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:34.863174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba32f3-4111-4673-8ebf-38f2a76b6ca7 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:34.866765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b763b-e63d-4214-bfd9-ae9291d9c5d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:34.867366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b763b-e63d-4214-bfd9-ae9291d9c5d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:34.867648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b763b-e63d-4214-bfd9-ae9291d9c5d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:34.867921 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b763b-e63d-4214-bfd9-ae9291d9c5d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:34.876856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b763b-e63d-4214-bfd9-ae9291d9c5d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:34.878345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b763b-e63d-4214-bfd9-ae9291d9c5d2 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:34.887719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1152/2286] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:37:35.324881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032fe9-172d-4296-831a-177c1e8dd012 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:35.326403 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9032fe9-172d-4296-831a-177c1e8dd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:35.345939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032fe9-172d-4296-831a-177c1e8dd012 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:35.347326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:35.347979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:35.348287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:35.348510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] PATH_INFO: `/v3/projects/f6cdf4b87c844a309e203f969f92709f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:35.350736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cdf4b87c844a309e203f969f92709f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:35.352430 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:35.458047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cdf4b87c844a309e203f969f92709f', 'request_id': 'req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:35.530394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cdf4b87c844a309e203f969f92709f', 'request_id': 'req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:35.538789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cdf4b87c844a309e203f969f92709f', 'request_id': 'req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:35.550774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] The token cache is being invalidate because project f6cdf4b87c844a309e203f969f92709f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:37:35.551067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:35.551797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e5a128a2-a7aa-40a8-b411-0ae11ef980b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:37:35.553908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1135/2287] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:37:35 2022] DELETE /identity/v3/projects/f6cdf4b87c844a309e203f969f92709f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:35.558747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa18e-0015-4def-ae3e-811848d0418d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:35.559250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa18e-0015-4def-ae3e-811848d0418d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:35.559343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa18e-0015-4def-ae3e-811848d0418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:35.584607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-096aa18e-0015-4def-ae3e-811848d0418d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:35.586587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-096aa18e-0015-4def-ae3e-811848d0418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:35.607408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:35.670505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1153/2288] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:35.679874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54095-75ea-4338-a53c-1c9121b3009b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:35.682675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54095-75ea-4338-a53c-1c9121b3009b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:35.682675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b54095-75ea-4338-a53c-1c9121b3009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:35.705025 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e7b54095-75ea-4338-a53c-1c9121b3009b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:35.706402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e7b54095-75ea-4338-a53c-1c9121b3009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:35.723595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1136/2289] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:35.723717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa18e-0015-4def-ae3e-811848d0418d None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:35.730005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa18e-0015-4def-ae3e-811848d0418d None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:35.735185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:35.735185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:35.735476 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:35.735812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:35.736399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:37:35.736700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:35.738352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:35.751753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1154/2290] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:37:35.756997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b54095-75ea-4338-a53c-1c9121b3009b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:35.766799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b54095-75ea-4338-a53c-1c9121b3009b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:35.772275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5adf4-1808-4305-bd1f-3ccddf2f2cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:35.773726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5adf4-1808-4305-bd1f-3ccddf2f2cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:35.773726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5adf4-1808-4305-bd1f-3ccddf2f2cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:35.773726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5adf4-1808-4305-bd1f-3ccddf2f2cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:35.774195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5adf4-1808-4305-bd1f-3ccddf2f2cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:35.776769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5adf4-1808-4305-bd1f-3ccddf2f2cf1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:35.889640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1137/2291] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:37:35 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:37:35.892142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:35.903089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77173fbc-bbbc-49ae-b53d-d4bb4f384317 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:35.958042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec8619-4018-4508-a9d0-20bfa3a2e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:35.958645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec8619-4018-4508-a9d0-20bfa3a2e80c admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:35.959474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec8619-4018-4508-a9d0-20bfa3a2e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:35.959752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec8619-4018-4508-a9d0-20bfa3a2e80c admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:35.960386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec8619-4018-4508-a9d0-20bfa3a2e80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:35.962376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec8619-4018-4508-a9d0-20bfa3a2e80c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:36.071203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1155/2292] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:37:35 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:37:36.074780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5adf4-1808-4305-bd1f-3ccddf2f2cf1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:36.090774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5adf4-1808-4305-bd1f-3ccddf2f2cf1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:36.098554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a72e-8751-4b6f-921c-3acf0069ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:36.099283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a72e-8751-4b6f-921c-3acf0069ea77 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:36.100105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a72e-8751-4b6f-921c-3acf0069ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:36.100105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a72e-8751-4b6f-921c-3acf0069ea77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:36.100598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855a72e-8751-4b6f-921c-3acf0069ea77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:36.102526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855a72e-8751-4b6f-921c-3acf0069ea77 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:36.125416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1138/2293] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:37:36.126009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec8619-4018-4508-a9d0-20bfa3a2e80c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:36.139442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec8619-4018-4508-a9d0-20bfa3a2e80c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:36.145674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38608c-62e7-4665-8f86-ea91af0e3cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:36.145674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38608c-62e7-4665-8f86-ea91af0e3cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:36.145674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38608c-62e7-4665-8f86-ea91af0e3cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:36.146051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38608c-62e7-4665-8f86-ea91af0e3cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:36.146684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38608c-62e7-4665-8f86-ea91af0e3cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:36.148278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38608c-62e7-4665-8f86-ea91af0e3cfb admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:36.163789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1156/2294] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:37:36.165216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a72e-8751-4b6f-921c-3acf0069ea77 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:36.184626 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a72e-8751-4b6f-921c-3acf0069ea77 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:36.190618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:36.199977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:36.200270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:36.200549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] PATH_INFO: `/v3/projects/9cebad2d8201484f948d1ac6062ebae1/users/00fe878ae7f047f9a7d5f939b5cb0ab1/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:36.219592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cebad2d8201484f948d1ac6062ebae1, user_id=00fe878ae7f047f9a7d5f939b5cb0ab1, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:36.222376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:36.296646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1139/2295] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:37:36 2022] PUT /identity/v3/projects/9cebad2d8201484f948d1ac6062ebae1/users/00fe878ae7f047f9a7d5f939b5cb0ab1/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:36.363860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd544f-b339-4095-aa75-ee4fe11aaed0 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:36.364146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd544f-b339-4095-aa75-ee4fe11aaed0 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:36.364457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd544f-b339-4095-aa75-ee4fe11aaed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:36.388426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-94bd544f-b339-4095-aa75-ee4fe11aaed0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:36.389817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-94bd544f-b339-4095-aa75-ee4fe11aaed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:36.473659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1157/2296] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:36.482572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:36.484405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:36.491966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:36.558306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42936c-f2ce-4074-bde6-8c39fa235fab admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:36.562191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0924e-bc93-4c75-9459-9b379a8cfda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:36.564953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0924e-bc93-4c75-9459-9b379a8cfda8 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:36.564953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0924e-bc93-4c75-9459-9b379a8cfda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:36.564953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0924e-bc93-4c75-9459-9b379a8cfda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:36.576078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0924e-bc93-4c75-9459-9b379a8cfda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:36.577562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0924e-bc93-4c75-9459-9b379a8cfda8 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:36.589119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1140/2297] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:37:42.883451 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73ea66-f29b-4848-9b37-c50b13e5accc None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:42.883980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73ea66-f29b-4848-9b37-c50b13e5accc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:42.884070 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73ea66-f29b-4848-9b37-c50b13e5accc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:42.905249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7b73ea66-f29b-4848-9b37-c50b13e5accc None None] MFA Rules not processed for user `148ab9508da34daba05ef09292d92a92`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:42.907916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7b73ea66-f29b-4848-9b37-c50b13e5accc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:42.956504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:43.017778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1158/2298] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:43.104313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae69f5-add7-426f-ac4c-664ad2b14c1c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.104313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae69f5-add7-426f-ac4c-664ad2b14c1c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.104313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae69f5-add7-426f-ac4c-664ad2b14c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.151416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-94ae69f5-add7-426f-ac4c-664ad2b14c1c None None] MFA Rules not processed for user `00fe878ae7f047f9a7d5f939b5cb0ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:43.153280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-94ae69f5-add7-426f-ac4c-664ad2b14c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:43.162491 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38334-76f4-4606-a8a2-345661d61cc1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.163111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38334-76f4-4606-a8a2-345661d61cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.163853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38334-76f4-4606-a8a2-345661d61cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.190991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-cfb38334-76f4-4606-a8a2-345661d61cc1 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:43.192376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cfb38334-76f4-4606-a8a2-345661d61cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:43.252752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1141/2299] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:43.253979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae69f5-add7-426f-ac4c-664ad2b14c1c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:43.273601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae69f5-add7-426f-ac4c-664ad2b14c1c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:43.279505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3674d-406d-4b04-8a54-9f0793bbb862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:43.280455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3674d-406d-4b04-8a54-9f0793bbb862 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.280885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3674d-406d-4b04-8a54-9f0793bbb862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.281315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3674d-406d-4b04-8a54-9f0793bbb862 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.282119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3674d-406d-4b04-8a54-9f0793bbb862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:43.282688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1159/2300] 10.222.0.61 () {58 vars in 967 bytes} [Tue Aug 23 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:37:43.284917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3674d-406d-4b04-8a54-9f0793bbb862 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:43.290886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38334-76f4-4606-a8a2-345661d61cc1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:43.292389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-cfb38334-76f4-4606-a8a2-345661d61cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:43.380675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38334-76f4-4606-a8a2-345661d61cc1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:43.387388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1142/2301] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:37:43.391702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3674d-406d-4b04-8a54-9f0793bbb862 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:43.470520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3674d-406d-4b04-8a54-9f0793bbb862 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:43.477257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb409-2438-4fec-bc94-542cd44363f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:43.478382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb409-2438-4fec-bc94-542cd44363f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.478590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd753649-77e6-4396-a0d2-990b88db7ec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:43.479031 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb409-2438-4fec-bc94-542cd44363f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.479213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd753649-77e6-4396-a0d2-990b88db7ec9 service swift] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.479501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd753649-77e6-4396-a0d2-990b88db7ec9 service swift] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.479781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb409-2438-4fec-bc94-542cd44363f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.479911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd753649-77e6-4396-a0d2-990b88db7ec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.480790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eb409-2438-4fec-bc94-542cd44363f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:43.483095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eb409-2438-4fec-bc94-542cd44363f5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:43.506864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:43.547896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd753649-77e6-4396-a0d2-990b88db7ec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:43.549495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd753649-77e6-4396-a0d2-990b88db7ec9 service swift] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:43.560961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1160/2302] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:37:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:37:43.588522 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1143/2303] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:37:43 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:37:43.589467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd753649-77e6-4396-a0d2-990b88db7ec9 service swift] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:43.611840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd753649-77e6-4396-a0d2-990b88db7ec9 service swift] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:43.632952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb95e70-a9ee-4578-9c4e-009cc00c7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:43.633422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95e70-a9ee-4578-9c4e-009cc00c7780 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.633758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95e70-a9ee-4578-9c4e-009cc00c7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.634033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb95e70-a9ee-4578-9c4e-009cc00c7780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.634687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb95e70-a9ee-4578-9c4e-009cc00c7780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:43.636923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb95e70-a9ee-4578-9c4e-009cc00c7780 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:43.653859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1161/2304] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:37:43.658721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb409-2438-4fec-bc94-542cd44363f5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:43.671423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:43.678967 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb409-2438-4fec-bc94-542cd44363f5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:43.683944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2fe6b-6f18-491d-9371-217c22e2945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:43.684609 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2fe6b-6f18-491d-9371-217c22e2945a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.687861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2fe6b-6f18-491d-9371-217c22e2945a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.687861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2fe6b-6f18-491d-9371-217c22e2945a admin admin] PATH_INFO: `/v3/projects/cb1e442637684113b258785c0c0c4f84/users/4ace722241bc4967af63cceb614e6ae6/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.702278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2fe6b-6f18-491d-9371-217c22e2945a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1e442637684113b258785c0c0c4f84, user_id=4ace722241bc4967af63cceb614e6ae6, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:43.705233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2fe6b-6f18-491d-9371-217c22e2945a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:43.834236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1144/2305] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:37:43 2022] PUT /identity/v3/projects/cb1e442637684113b258785c0c0c4f84/users/4ace722241bc4967af63cceb614e6ae6/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:37:43.838309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb95e70-a9ee-4578-9c4e-009cc00c7780 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:43.849631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb95e70-a9ee-4578-9c4e-009cc00c7780 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:43.923040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c0787-37e8-438f-b9af-3226fdc1ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:43.930168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c0787-37e8-438f-b9af-3226fdc1ff95 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.930608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c0787-37e8-438f-b9af-3226fdc1ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.930954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c0787-37e8-438f-b9af-3226fdc1ff95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.931849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c0787-37e8-438f-b9af-3226fdc1ff95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:43.933715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c0787-37e8-438f-b9af-3226fdc1ff95 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:43.951828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1162/2306] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:37:43.955292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2fe6b-6f18-491d-9371-217c22e2945a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:43.965955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2fe6b-6f18-491d-9371-217c22e2945a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:43.979869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:43.981386 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:43.982311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:43.982758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] PATH_INFO: `/v3/projects/cb1e442637684113b258785c0c0c4f84/users/4ace722241bc4967af63cceb614e6ae6/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:43.985761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1e442637684113b258785c0c0c4f84, user_id=4ace722241bc4967af63cceb614e6ae6, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:43.992678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:44.042363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1145/2307] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:37:43 2022] PUT /identity/v3/projects/cb1e442637684113b258785c0c0c4f84/users/4ace722241bc4967af63cceb614e6ae6/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:37:51.955564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367b04-9b18-46bc-828c-2f1f18c94890 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:51.956093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367b04-9b18-46bc-828c-2f1f18c94890 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:51.956215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367b04-9b18-46bc-828c-2f1f18c94890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:52.008068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-c2367b04-9b18-46bc-828c-2f1f18c94890 None None] MFA Rules not processed for user `4ace722241bc4967af63cceb614e6ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:52.010186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c2367b04-9b18-46bc-828c-2f1f18c94890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:52.139846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1163/2308] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:37:52.155227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:52.155949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:52.216988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83206e-6428-40a8-b686-12b61bf7beaf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:52.220968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ad80-b41e-4bd3-a5b8-4e26fc524205 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8070d1891844da59196d00ebbdff832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:52.221576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ad80-b41e-4bd3-a5b8-4e26fc524205 service glance] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:52.221880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ad80-b41e-4bd3-a5b8-4e26fc524205 service glance] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:52.222147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ad80-b41e-4bd3-a5b8-4e26fc524205 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:52.282279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ad80-b41e-4bd3-a5b8-4e26fc524205 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:52.283708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ad80-b41e-4bd3-a5b8-4e26fc524205 service glance] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:52.293037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1146/2309] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:37:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:37:52.582239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652a64-9868-40c5-a8a7-947cad2737b0 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:52.582528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652a64-9868-40c5-a8a7-947cad2737b0 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:52.582804 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652a64-9868-40c5-a8a7-947cad2737b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:52.602312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-41652a64-9868-40c5-a8a7-947cad2737b0 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:37:52.603552 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-41652a64-9868-40c5-a8a7-947cad2737b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:37:52.632440 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:37:52.659204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1164/2310] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:37:52.681255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ad80-b41e-4bd3-a5b8-4e26fc524205 service glance] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:37:52.748269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ad80-b41e-4bd3-a5b8-4e26fc524205 service glance] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:37:52.753396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc536b1-5e55-44a3-a5f3-05610f18dc01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:37:52.754034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc536b1-5e55-44a3-a5f3-05610f18dc01 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:37:52.754317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc536b1-5e55-44a3-a5f3-05610f18dc01 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:37:52.754595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc536b1-5e55-44a3-a5f3-05610f18dc01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:37:52.763912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc536b1-5e55-44a3-a5f3-05610f18dc01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:37:52.765909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc536b1-5e55-44a3-a5f3-05610f18dc01 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:37:52.775549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1147/2311] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:37:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:38:02.667919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=10 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:02.771522 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:04.392090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a6dc-2d05-4379-a3c1-a412b6b52717 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:04.392655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a6dc-2d05-4379-a3c1-a412b6b52717 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:04.392655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a6dc-2d05-4379-a3c1-a412b6b52717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:04.411832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d849a6dc-2d05-4379-a3c1-a412b6b52717 None None] MFA Rules not processed for user `00fe878ae7f047f9a7d5f939b5cb0ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:04.413571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d849a6dc-2d05-4379-a3c1-a412b6b52717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:04.420588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1165/2312] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:08.035444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bbd6b-df41-4051-ad26-3552cd49c732 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:08.036059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bbd6b-df41-4051-ad26-3552cd49c732 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:08.036059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bbd6b-df41-4051-ad26-3552cd49c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:08.063527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-295bbd6b-df41-4051-ad26-3552cd49c732 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:08.064449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-295bbd6b-df41-4051-ad26-3552cd49c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:08.151527 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1148/2313] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:08.175013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849a6dc-2d05-4379-a3c1-a412b6b52717 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:08.176687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d849a6dc-2d05-4379-a3c1-a412b6b52717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:08.255155 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849a6dc-2d05-4379-a3c1-a412b6b52717 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:08.261805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdb53c-93a1-4787-aa19-bde01277bf0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:08.262421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb53c-93a1-4787-aa19-bde01277bf0d service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:08.262688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb53c-93a1-4787-aa19-bde01277bf0d service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:08.262961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb53c-93a1-4787-aa19-bde01277bf0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:08.271793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdb53c-93a1-4787-aa19-bde01277bf0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:08.273930 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdb53c-93a1-4787-aa19-bde01277bf0d service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:08.283358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1166/2314] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:09.530106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e09aa-665d-47d5-b100-3a8d770f386c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:09.530819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e09aa-665d-47d5-b100-3a8d770f386c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:09.530976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e09aa-665d-47d5-b100-3a8d770f386c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:09.566325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8e3e09aa-665d-47d5-b100-3a8d770f386c None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:09.569452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8e3e09aa-665d-47d5-b100-3a8d770f386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:09.582443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1149/2315] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:38:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:09.603509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdb53c-93a1-4787-aa19-bde01277bf0d service nova] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:09.627173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdb53c-93a1-4787-aa19-bde01277bf0d service nova] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:09.637004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:09.638176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:09.638764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:09.639388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:09.656145 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:09.659307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:09.681666 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1167/2316] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:38:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:38:19.558205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=30 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:19.667971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=43 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:22.805744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb619-015d-45b6-adf2-9bdf760044b0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:22.806323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb619-015d-45b6-adf2-9bdf760044b0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:22.806323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb619-015d-45b6-adf2-9bdf760044b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:22.826228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4cdbb619-015d-45b6-adf2-9bdf760044b0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:22.827445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4cdbb619-015d-45b6-adf2-9bdf760044b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:22.842598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1150/2317] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:22.871813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:22.873571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:22.894519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef3a2-6003-4aeb-b4c9-9b831c1e54d6 service swift] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:22.900333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fa3dd-1913-44dc-971c-f0e966babab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:22.901075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fa3dd-1913-44dc-971c-f0e966babab6 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:22.901445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fa3dd-1913-44dc-971c-f0e966babab6 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:22.901967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fa3dd-1913-44dc-971c-f0e966babab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:22.911007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fa3dd-1913-44dc-971c-f0e966babab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:22.912597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fa3dd-1913-44dc-971c-f0e966babab6 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:22.922322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1168/2318] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:27.141728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb6f91-7433-4c49-b4b7-5a3e21384045 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:27.142292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb6f91-7433-4c49-b4b7-5a3e21384045 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:27.142411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb6f91-7433-4c49-b4b7-5a3e21384045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:27.163964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-eabb6f91-7433-4c49-b4b7-5a3e21384045 None None] MFA Rules not processed for user `ab934520bd5e4a5e9c82fdfacbf99f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:27.165177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-eabb6f91-7433-4c49-b4b7-5a3e21384045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:27.222213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1151/2319] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:38:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:28.767888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f28c1-7ac8-42a1-9690-15e8864c812b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:28.768472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f28c1-7ac8-42a1-9690-15e8864c812b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:28.768560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f28c1-7ac8-42a1-9690-15e8864c812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:28.789369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-832f28c1-7ac8-42a1-9690-15e8864c812b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:28.790616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-832f28c1-7ac8-42a1-9690-15e8864c812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:28.798526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1169/2320] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:28.848065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb6f91-7433-4c49-b4b7-5a3e21384045 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:28.866826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb6f91-7433-4c49-b4b7-5a3e21384045 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:28.872777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cd870-3ce0-4d2d-afd6-f3893109bc10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:28.873430 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cd870-3ce0-4d2d-afd6-f3893109bc10 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:28.873740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cd870-3ce0-4d2d-afd6-f3893109bc10 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:28.874009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cd870-3ce0-4d2d-afd6-f3893109bc10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:28.883495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cd870-3ce0-4d2d-afd6-f3893109bc10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:28.885668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cd870-3ce0-4d2d-afd6-f3893109bc10 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:28.895258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1152/2321] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:33.014731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8be2-52fa-45d4-8b20-2d843063a05d None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:33.015271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8be2-52fa-45d4-8b20-2d843063a05d None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:33.015271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8be2-52fa-45d4-8b20-2d843063a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:33.036335 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e4bf8be2-52fa-45d4-8b20-2d843063a05d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:33.038101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e4bf8be2-52fa-45d4-8b20-2d843063a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:33.045881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1170/2322] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:33.075762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cd870-3ce0-4d2d-afd6-f3893109bc10 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:33.087628 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cd870-3ce0-4d2d-afd6-f3893109bc10 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:33.093108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f3f2-ce20-4b97-b34d-5d47e52a6bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:33.093768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f3f2-ce20-4b97-b34d-5d47e52a6bea service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:33.094055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f3f2-ce20-4b97-b34d-5d47e52a6bea service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:33.094330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f3f2-ce20-4b97-b34d-5d47e52a6bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:33.103455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f3f2-ce20-4b97-b34d-5d47e52a6bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:33.105043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f3f2-ce20-4b97-b34d-5d47e52a6bea service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:33.114541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1153/2323] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:38:40.419406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c874c-388f-46a3-8e0e-2c723c105b05 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:40.419941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c874c-388f-46a3-8e0e-2c723c105b05 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:40.420048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c874c-388f-46a3-8e0e-2c723c105b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:40.439566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7c7c874c-388f-46a3-8e0e-2c723c105b05 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:38:40.440684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7c7c874c-388f-46a3-8e0e-2c723c105b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:40.449262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1171/2324] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Aug 23 16:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:38:40.480126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f3f2-ce20-4b97-b34d-5d47e52a6bea service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:40.491631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f3f2-ce20-4b97-b34d-5d47e52a6bea service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:40.497438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c454cb-ff63-4bae-931e-50d3606ddbe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:40.498072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c454cb-ff63-4bae-931e-50d3606ddbe4 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:40.498408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c454cb-ff63-4bae-931e-50d3606ddbe4 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:40.498691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c454cb-ff63-4bae-931e-50d3606ddbe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:40.507458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c454cb-ff63-4bae-931e-50d3606ddbe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:40.509038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c454cb-ff63-4bae-931e-50d3606ddbe4 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:40.518643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1154/2325] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:50.175256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c874c-388f-46a3-8e0e-2c723c105b05 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:50.181789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=16 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:50.236356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c874c-388f-46a3-8e0e-2c723c105b05 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:50.241908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecc7ae-31a4-44dc-b108-322b90a379bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:50.242596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc7ae-31a4-44dc-b108-322b90a379bf service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:50.242884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc7ae-31a4-44dc-b108-322b90a379bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:50.243274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecc7ae-31a4-44dc-b108-322b90a379bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:50.255538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecc7ae-31a4-44dc-b108-322b90a379bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:50.257069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecc7ae-31a4-44dc-b108-322b90a379bf service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:50.270683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1172/2326] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:38:50.514315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=46 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:00.218663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af60c1-47db-49b2-8614-6fce4293bf77 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:00.219257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af60c1-47db-49b2-8614-6fce4293bf77 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:00.219257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af60c1-47db-49b2-8614-6fce4293bf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:00.245778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-90af60c1-47db-49b2-8614-6fce4293bf77 None None] MFA Rules not processed for user `7406a426e16a415e9c1f457f58a0871b`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:00.245778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-90af60c1-47db-49b2-8614-6fce4293bf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:00.328891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1155/2327] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:00.344506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=25 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:08.153118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f6e1-0097-4789-b815-91f71663efe0 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:08.153762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f6e1-0097-4789-b815-91f71663efe0 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:08.153762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f6e1-0097-4789-b815-91f71663efe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:08.176818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7ca3f6e1-0097-4789-b815-91f71663efe0 None None] MFA Rules not processed for user `f2d6e1a8b75547468e2294bff8274c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:08.178126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7ca3f6e1-0097-4789-b815-91f71663efe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:08.242721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1173/2328] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:10.318454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=25 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:11.214994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b0beb-3f2d-4160-985f-f254eee8a4a7 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:11.215382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b0beb-3f2d-4160-985f-f254eee8a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:11.215847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b0beb-3f2d-4160-985f-f254eee8a4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:11.258607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-8e1b0beb-3f2d-4160-985f-f254eee8a4a7 None None] MFA Rules not processed for user `21f47cbaa3084658a6b60da569419ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:11.259862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8e1b0beb-3f2d-4160-985f-f254eee8a4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:11.317856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1156/2329] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:18.236378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=25 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:21.280888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f6e1-0097-4789-b815-91f71663efe0 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:21.291473 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f6e1-0097-4789-b815-91f71663efe0 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:21.295162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1212-50d0-4bd5-abda-b6e75bf68491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:21.295791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1212-50d0-4bd5-abda-b6e75bf68491 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:21.296052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1212-50d0-4bd5-abda-b6e75bf68491 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:21.296324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1212-50d0-4bd5-abda-b6e75bf68491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:21.298213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6aba1212-50d0-4bd5-abda-b6e75bf68491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:21.310946 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=25 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:21.312252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba1212-50d0-4bd5-abda-b6e75bf68491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:21.313725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba1212-50d0-4bd5-abda-b6e75bf68491 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:21.325554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1174/2330] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:21.833671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b0beb-3f2d-4160-985f-f254eee8a4a7 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:21.843225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b0beb-3f2d-4160-985f-f254eee8a4a7 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:21.846816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d6703-c7da-4e88-8d46-c14fd9ce0a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:21.847414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6703-c7da-4e88-8d46-c14fd9ce0a9d service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:21.847695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6703-c7da-4e88-8d46-c14fd9ce0a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:21.847972 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d6703-c7da-4e88-8d46-c14fd9ce0a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:21.849713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-328d6703-c7da-4e88-8d46-c14fd9ce0a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:21.864044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d6703-c7da-4e88-8d46-c14fd9ce0a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:21.865480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d6703-c7da-4e88-8d46-c14fd9ce0a9d service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:21.876174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1157/2331] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:23.904694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156caf-8060-463a-b9a2-f337fab9351b None None] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:23.905250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156caf-8060-463a-b9a2-f337fab9351b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:23.905250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156caf-8060-463a-b9a2-f337fab9351b None None] PATH_INFO: `/` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:23.906638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1175/2332] 10.222.0.61 () {54 vars in 921 bytes} [Tue Aug 23 16:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:39:23.931937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea31e0-9c85-45b6-be3b-b1efaf5e7b34 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:23.932418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea31e0-9c85-45b6-be3b-b1efaf5e7b34 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:23.932530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea31e0-9c85-45b6-be3b-b1efaf5e7b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:23.952890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ddea31e0-9c85-45b6-be3b-b1efaf5e7b34 None None] MFA Rules not processed for user `4aea4da0e5e342a39974c08bf69518e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:23.954122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ddea31e0-9c85-45b6-be3b-b1efaf5e7b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:24.022505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1158/2333] 10.222.0.61 () {58 vars in 1018 bytes} [Tue Aug 23 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:24.047053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156caf-8060-463a-b9a2-f337fab9351b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:24.049330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6a156caf-8060-463a-b9a2-f337fab9351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:24.071519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156caf-8060-463a-b9a2-f337fab9351b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:24.077845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4ecf-e792-47ec-a734-1ac413118ce1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:24.078466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4ecf-e792-47ec-a734-1ac413118ce1 service placement] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:24.078997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4ecf-e792-47ec-a734-1ac413118ce1 service placement] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:24.078997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4ecf-e792-47ec-a734-1ac413118ce1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:24.089347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d4ecf-e792-47ec-a734-1ac413118ce1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:24.091028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d4ecf-e792-47ec-a734-1ac413118ce1 service placement] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:24.104481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1176/2334] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:24.105292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea31e0-9c85-45b6-be3b-b1efaf5e7b34 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:24.106770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ddea31e0-9c85-45b6-be3b-b1efaf5e7b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:24.122154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea31e0-9c85-45b6-be3b-b1efaf5e7b34 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:24.128131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:24.128765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:24.128997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:24.129275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] PATH_INFO: `/v3/users/148ab9508da34daba05ef09292d92a92` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:24.130459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=148ab9508da34daba05ef09292d92a92)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:24.132369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:24.295414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148ab9508da34daba05ef09292d92a92'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.302915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148ab9508da34daba05ef09292d92a92'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.307183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148ab9508da34daba05ef09292d92a92'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.307183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148ab9508da34daba05ef09292d92a92'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.316907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148ab9508da34daba05ef09292d92a92'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.389806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1159/2335] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:39:24 2022] DELETE /identity/v3/users/148ab9508da34daba05ef09292d92a92 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:39:24.686455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4ecf-e792-47ec-a734-1ac413118ce1 service placement] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:24.697526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4ecf-e792-47ec-a734-1ac413118ce1 service placement] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:24.763635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:24.764276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:24.764566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:24.764829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] PATH_INFO: `/v3/projects/32a83af0151b48a5a1428996ca0b58b5` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:24.766000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a83af0151b48a5a1428996ca0b58b5)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:24.768190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:24.881858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a83af0151b48a5a1428996ca0b58b5', 'request_id': 'req-98de1d5a-4b0c-48da-ae0c-9bd952c42326'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.888063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a83af0151b48a5a1428996ca0b58b5', 'request_id': 'req-98de1d5a-4b0c-48da-ae0c-9bd952c42326'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.960421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a83af0151b48a5a1428996ca0b58b5', 'request_id': 'req-98de1d5a-4b0c-48da-ae0c-9bd952c42326'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.974316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] The token cache is being invalidate because project 32a83af0151b48a5a1428996ca0b58b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:39:24.974610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.975492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:24.977098 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1177/2336] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:39:24 2022] DELETE /identity/v3/projects/32a83af0151b48a5a1428996ca0b58b5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:34.385935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:34.970430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:39.801339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:39.802797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:39.875863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5753b-d2ba-43f7-a965-cb902c5a8a7d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:39.937524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:39.938082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:39.938364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:39.938636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:39.940356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:39.999582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:40.001202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:40.010666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1160/2337] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:46.191334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:46.192808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:46.249548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de1d5a-4b0c-48da-ae0c-9bd952c42326 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:46.253174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:46.253808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:46.254091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:46.254365 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:46.256084 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:46.317590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:46.319059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:46.328611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1178/2338] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:50.006576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=84 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:50.149926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:50.151379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:50.167123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb67cc-b64f-43db-b096-9a6e9168fa81 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:50.172275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:50.172817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:50.173098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:50.173368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] PATH_INFO: `/v3/users/ab934520bd5e4a5e9c82fdfacbf99f5c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:50.174524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab934520bd5e4a5e9c82fdfacbf99f5c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:50.176530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:50.348167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab934520bd5e4a5e9c82fdfacbf99f5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.355101 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab934520bd5e4a5e9c82fdfacbf99f5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.355789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab934520bd5e4a5e9c82fdfacbf99f5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.356410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab934520bd5e4a5e9c82fdfacbf99f5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.368707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4a7bf6cd-8f67-4c96-8b73-702cb4a1eda9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab934520bd5e4a5e9c82fdfacbf99f5c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.449118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1161/2339] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:39:50 2022] DELETE /identity/v3/users/ab934520bd5e4a5e9c82fdfacbf99f5c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:50.698727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:50.710498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9579f-9561-4a28-b983-211b0326d360 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:50.770218 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:50.770855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:50.771165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:50.771436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] PATH_INFO: `/v3/projects/4eb4d34120324f098decdeee786839a1` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:50.772578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb4d34120324f098decdeee786839a1)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:50.774534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:50.880030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb4d34120324f098decdeee786839a1', 'request_id': 'req-954258c0-cecd-44ea-a1b7-49a78fff7a6b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.881900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:50.886230 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb4d34120324f098decdeee786839a1', 'request_id': 'req-954258c0-cecd-44ea-a1b7-49a78fff7a6b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.959073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb4d34120324f098decdeee786839a1', 'request_id': 'req-954258c0-cecd-44ea-a1b7-49a78fff7a6b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.969934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] The token cache is being invalidate because project 4eb4d34120324f098decdeee786839a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:39:50.970231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.970858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-954258c0-cecd-44ea-a1b7-49a78fff7a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:50.972872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1179/2340] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:39:50 2022] DELETE /identity/v3/projects/4eb4d34120324f098decdeee786839a1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:50.977845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054c9e4-fece-49e7-b0af-aa4a99ab05f0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:50.978192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054c9e4-fece-49e7-b0af-aa4a99ab05f0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:50.978476 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054c9e4-fece-49e7-b0af-aa4a99ab05f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:50.998099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5054c9e4-fece-49e7-b0af-aa4a99ab05f0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:50.999297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5054c9e4-fece-49e7-b0af-aa4a99ab05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:51.069792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1162/2341] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:51.077417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab539-24c2-4417-b6bc-bd5deaae16ee None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.077741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab539-24c2-4417-b6bc-bd5deaae16ee None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.078020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ab539-24c2-4417-b6bc-bd5deaae16ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.099298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2a1ab539-24c2-4417-b6bc-bd5deaae16ee None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:51.100761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2a1ab539-24c2-4417-b6bc-bd5deaae16ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:51.108406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1180/2342] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:51.112647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054c9e4-fece-49e7-b0af-aa4a99ab05f0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.122170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054c9e4-fece-49e7-b0af-aa4a99ab05f0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.126726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.127325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.127610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.127888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.129048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:39:51.129348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.130984 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:51.142870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1163/2343] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:39:51.147537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ab539-24c2-4417-b6bc-bd5deaae16ee None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.156826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ab539-24c2-4417-b6bc-bd5deaae16ee None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.161478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4450-4f6e-486e-be6f-9ef2444517d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.162089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4450-4f6e-486e-be6f-9ef2444517d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.162368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4450-4f6e-486e-be6f-9ef2444517d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.162635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4450-4f6e-486e-be6f-9ef2444517d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.163257 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f4450-4f6e-486e-be6f-9ef2444517d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.165136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f4450-4f6e-486e-be6f-9ef2444517d8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:51.240525 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1181/2344] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:39:51 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:39:51.244480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.254954 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7ca91-6dc6-48f9-8f39-e612d3a6f728 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.309601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c4d77-11c2-424e-b93d-b2c009ae844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.310221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c4d77-11c2-424e-b93d-b2c009ae844f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.310502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c4d77-11c2-424e-b93d-b2c009ae844f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.310773 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c4d77-11c2-424e-b93d-b2c009ae844f admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.311400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c4d77-11c2-424e-b93d-b2c009ae844f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.313304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c4d77-11c2-424e-b93d-b2c009ae844f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:51.321510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:51.383098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1164/2345] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:39:51 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:39:51.387913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4450-4f6e-486e-be6f-9ef2444517d8 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.399255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4450-4f6e-486e-be6f-9ef2444517d8 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.404007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb25f-9195-4c80-94c4-ba613b7c6244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.405151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb25f-9195-4c80-94c4-ba613b7c6244 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.405151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb25f-9195-4c80-94c4-ba613b7c6244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.405151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bb25f-9195-4c80-94c4-ba613b7c6244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.405936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bb25f-9195-4c80-94c4-ba613b7c6244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.407539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bb25f-9195-4c80-94c4-ba613b7c6244 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:51.417902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1182/2346] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:39:51.422118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c4d77-11c2-424e-b93d-b2c009ae844f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.432170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c4d77-11c2-424e-b93d-b2c009ae844f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.437068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7f041-c180-4fdd-afde-6fe677cca948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.437729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7f041-c180-4fdd-afde-6fe677cca948 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.438013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7f041-c180-4fdd-afde-6fe677cca948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.438289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7f041-c180-4fdd-afde-6fe677cca948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.438938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7f041-c180-4fdd-afde-6fe677cca948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.440559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7f041-c180-4fdd-afde-6fe677cca948 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:51.452093 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1165/2347] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:39:51.456379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb25f-9195-4c80-94c4-ba613b7c6244 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.466732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bb25f-9195-4c80-94c4-ba613b7c6244 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.471472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8641e-0931-4d65-9142-a396a75e0e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.472116 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8641e-0931-4d65-9142-a396a75e0e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.472395 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8641e-0931-4d65-9142-a396a75e0e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.472668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8641e-0931-4d65-9142-a396a75e0e2c admin admin] PATH_INFO: `/v3/projects/079d9d43165341a8b2a6f1f6b323ca92/users/bd5fba4230f043178041f0dc40d6b393/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.487030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8641e-0931-4d65-9142-a396a75e0e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=079d9d43165341a8b2a6f1f6b323ca92, user_id=bd5fba4230f043178041f0dc40d6b393, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.490231 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8641e-0931-4d65-9142-a396a75e0e2c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:51.565022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1183/2348] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:39:51 2022] PUT /identity/v3/projects/079d9d43165341a8b2a6f1f6b323ca92/users/bd5fba4230f043178041f0dc40d6b393/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:51.575882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75fe2-e9e7-49b0-8295-c35ae28f9113 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.576207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75fe2-e9e7-49b0-8295-c35ae28f9113 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.576490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75fe2-e9e7-49b0-8295-c35ae28f9113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.603122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bdd75fe2-e9e7-49b0-8295-c35ae28f9113 None None] MFA Rules not processed for user `bd5fba4230f043178041f0dc40d6b393`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:51.604322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bdd75fe2-e9e7-49b0-8295-c35ae28f9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:51.667366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1166/2349] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:51.671885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8641e-0931-4d65-9142-a396a75e0e2c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.731592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8641e-0931-4d65-9142-a396a75e0e2c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.736195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cc4b2-1eb8-41d1-a03e-208eb2e8841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.736791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc4b2-1eb8-41d1-a03e-208eb2e8841c admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.737072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc4b2-1eb8-41d1-a03e-208eb2e8841c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.737343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc4b2-1eb8-41d1-a03e-208eb2e8841c admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.738513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cc4b2-1eb8-41d1-a03e-208eb2e8841c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.740411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cc4b2-1eb8-41d1-a03e-208eb2e8841c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:51.828509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1184/2350] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:39:51 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:39:51.832601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd75fe2-e9e7-49b0-8295-c35ae28f9113 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:51.843358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd75fe2-e9e7-49b0-8295-c35ae28f9113 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:51.907499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292ead-bdf7-4e23-a485-0e1ab6c57d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:51.908292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292ead-bdf7-4e23-a485-0e1ab6c57d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:51.908429 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292ead-bdf7-4e23-a485-0e1ab6c57d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:51.908713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27292ead-bdf7-4e23-a485-0e1ab6c57d9b admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:51.909349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27292ead-bdf7-4e23-a485-0e1ab6c57d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:51.912057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27292ead-bdf7-4e23-a485-0e1ab6c57d9b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:52.087523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1167/2351] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:39:51 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:39:52.088919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cc4b2-1eb8-41d1-a03e-208eb2e8841c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:52.099653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cc4b2-1eb8-41d1-a03e-208eb2e8841c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:52.104201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de7d05-d39a-49c4-9356-2d3e7fd25ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:52.110008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7d05-d39a-49c4-9356-2d3e7fd25ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:52.110008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7d05-d39a-49c4-9356-2d3e7fd25ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:52.110008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7d05-d39a-49c4-9356-2d3e7fd25ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:52.110008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de7d05-d39a-49c4-9356-2d3e7fd25ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:52.110008 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de7d05-d39a-49c4-9356-2d3e7fd25ac5 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:52.118514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1185/2352] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:39:52.122542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292ead-bdf7-4e23-a485-0e1ab6c57d9b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:52.132484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27292ead-bdf7-4e23-a485-0e1ab6c57d9b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:52.137299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50639115-7a50-43ea-9d71-a0a16f85129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:52.138094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50639115-7a50-43ea-9d71-a0a16f85129d admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:52.138383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50639115-7a50-43ea-9d71-a0a16f85129d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:52.138655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50639115-7a50-43ea-9d71-a0a16f85129d admin admin] PATH_INFO: `/v3/projects/a43a0ef05235463a9b74c4fbda933b2a/users/3d971eb372c5436f96e68642f089b2d0/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:52.153483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50639115-7a50-43ea-9d71-a0a16f85129d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43a0ef05235463a9b74c4fbda933b2a, user_id=3d971eb372c5436f96e68642f089b2d0, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:52.156276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50639115-7a50-43ea-9d71-a0a16f85129d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:52.232426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1168/2353] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:39:52 2022] PUT /identity/v3/projects/a43a0ef05235463a9b74c4fbda933b2a/users/3d971eb372c5436f96e68642f089b2d0/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:52.236359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de7d05-d39a-49c4-9356-2d3e7fd25ac5 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:52.246797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de7d05-d39a-49c4-9356-2d3e7fd25ac5 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:52.292589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:52.301926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e5c91-e502-4f11-bab5-cf8766c5264f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:52.302523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5c91-e502-4f11-bab5-cf8766c5264f admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:52.302798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5c91-e502-4f11-bab5-cf8766c5264f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:52.303067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5c91-e502-4f11-bab5-cf8766c5264f admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:52.303700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e5c91-e502-4f11-bab5-cf8766c5264f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:52.305280 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e5c91-e502-4f11-bab5-cf8766c5264f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:52.314702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1186/2354] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:39:52.318917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50639115-7a50-43ea-9d71-a0a16f85129d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:52.329032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50639115-7a50-43ea-9d71-a0a16f85129d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:52.334442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:52.335367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:52.335655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:52.335935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] PATH_INFO: `/v3/projects/a43a0ef05235463a9b74c4fbda933b2a/users/3d971eb372c5436f96e68642f089b2d0/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:52.338118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43a0ef05235463a9b74c4fbda933b2a, user_id=3d971eb372c5436f96e68642f089b2d0, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:52.340839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:52.351783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1169/2355] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:39:52 2022] PUT /identity/v3/projects/a43a0ef05235463a9b74c4fbda933b2a/users/3d971eb372c5436f96e68642f089b2d0/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:39:52.362934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f6a43-45af-4128-a0f6-0fb522ba4ba1 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:52.363264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f6a43-45af-4128-a0f6-0fb522ba4ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:52.363540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f6a43-45af-4128-a0f6-0fb522ba4ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:52.391014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ba6f6a43-45af-4128-a0f6-0fb522ba4ba1 None None] MFA Rules not processed for user `3d971eb372c5436f96e68642f089b2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:52.392248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ba6f6a43-45af-4128-a0f6-0fb522ba4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:52.467710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1187/2356] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:52.479491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:52.481153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:52.503918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:52.540073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0be467-defb-4228-8e94-4899ab01807a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:52.543631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db58c0e-6d6e-4132-94bf-aec430368d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:52.544225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58c0e-6d6e-4132-94bf-aec430368d05 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:52.544502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58c0e-6d6e-4132-94bf-aec430368d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:52.544771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58c0e-6d6e-4132-94bf-aec430368d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:52.553504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db58c0e-6d6e-4132-94bf-aec430368d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:52.554962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db58c0e-6d6e-4132-94bf-aec430368d05 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:52.564307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1170/2357] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:52.658947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f6a43-45af-4128-a0f6-0fb522ba4ba1 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:52.661815 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ba6f6a43-45af-4128-a0f6-0fb522ba4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:52.672177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f6a43-45af-4128-a0f6-0fb522ba4ba1 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:52.675745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b306a-0abd-48c4-bfdb-15e104e9c9c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:52.676342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b306a-0abd-48c4-bfdb-15e104e9c9c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:52.676623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b306a-0abd-48c4-bfdb-15e104e9c9c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:52.676897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b306a-0abd-48c4-bfdb-15e104e9c9c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:52.732528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b306a-0abd-48c4-bfdb-15e104e9c9c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:52.734016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b306a-0abd-48c4-bfdb-15e104e9c9c8 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:52.742778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1188/2358] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:57.319297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db58c0e-6d6e-4132-94bf-aec430368d05 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:57.379563 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db58c0e-6d6e-4132-94bf-aec430368d05 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:57.384538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:57.385135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:57.385411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:57.385710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] PATH_INFO: `/v3/users/bd5fba4230f043178041f0dc40d6b393` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:57.386806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5fba4230f043178041f0dc40d6b393)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:57.388689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:57.575841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5fba4230f043178041f0dc40d6b393'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:57.582663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5fba4230f043178041f0dc40d6b393'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:57.583339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5fba4230f043178041f0dc40d6b393'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:57.583940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5fba4230f043178041f0dc40d6b393'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:57.595748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5fba4230f043178041f0dc40d6b393'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:57.664991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1171/2359] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:39:57 2022] DELETE /identity/v3/users/bd5fba4230f043178041f0dc40d6b393 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:57.669870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf700-0528-4753-a834-74d683169ced None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:57.670312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf700-0528-4753-a834-74d683169ced None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:57.670611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdf700-0528-4753-a834-74d683169ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:57.689421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-74bdf700-0528-4753-a834-74d683169ced None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:57.690643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-74bdf700-0528-4753-a834-74d683169ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:57.747602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1189/2360] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:57.758107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:57.759507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:57.806002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:57.817311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf97e6-ca3d-4f7e-bfce-4083896f7e5c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:57.821814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb60809-ef3a-4e67-af82-4bc423a85ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:57.822414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb60809-ef3a-4e67-af82-4bc423a85ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:57.822691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb60809-ef3a-4e67-af82-4bc423a85ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:57.822957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb60809-ef3a-4e67-af82-4bc423a85ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:57.831838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb60809-ef3a-4e67-af82-4bc423a85ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:57.833422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb60809-ef3a-4e67-af82-4bc423a85ab6 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:57.843114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1172/2361] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:39:58.229009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdf700-0528-4753-a834-74d683169ced None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:58.230505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-74bdf700-0528-4753-a834-74d683169ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:58.243228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdf700-0528-4753-a834-74d683169ced None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:58.247836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:58.248476 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:58.248753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:58.249029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] PATH_INFO: `/v3/projects/079d9d43165341a8b2a6f1f6b323ca92` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:58.250313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=079d9d43165341a8b2a6f1f6b323ca92)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:58.252265 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:58.259952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:58.365255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '079d9d43165341a8b2a6f1f6b323ca92', 'request_id': 'req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.371590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '079d9d43165341a8b2a6f1f6b323ca92', 'request_id': 'req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.467020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '079d9d43165341a8b2a6f1f6b323ca92', 'request_id': 'req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.478009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] The token cache is being invalidate because project 079d9d43165341a8b2a6f1f6b323ca92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:39:58.478417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.479089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.480578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1190/2362] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:39:58 2022] DELETE /identity/v3/projects/079d9d43165341a8b2a6f1f6b323ca92 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:58.484711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb60809-ef3a-4e67-af82-4bc423a85ab6 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:58.495174 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb60809-ef3a-4e67-af82-4bc423a85ab6 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:58.551027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:58.552257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:58.552543 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:58.552818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] PATH_INFO: `/v3/users/3d971eb372c5436f96e68642f089b2d0` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:58.553961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d971eb372c5436f96e68642f089b2d0)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:58.555853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:58.749378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d971eb372c5436f96e68642f089b2d0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.756203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d971eb372c5436f96e68642f089b2d0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.756894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d971eb372c5436f96e68642f089b2d0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.757496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d971eb372c5436f96e68642f089b2d0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.769783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e798b977-a242-4ec7-a400-3dbe8aa2a01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d971eb372c5436f96e68642f089b2d0'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:58.826053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1173/2363] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:39:58 2022] DELETE /identity/v3/users/3d971eb372c5436f96e68642f089b2d0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:59.228677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:59.230248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:59.243940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac015a1-5d2a-4fa8-a346-321ec884fdc9 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:59.303370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:59.304020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.304287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.304561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] PATH_INFO: `/v3/projects/a43a0ef05235463a9b74c4fbda933b2a` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.305842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43a0ef05235463a9b74c4fbda933b2a)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:59.307773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:59.420498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43a0ef05235463a9b74c4fbda933b2a', 'request_id': 'req-5ad81eef-b695-4e96-8581-a3323d428a18'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:59.427438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43a0ef05235463a9b74c4fbda933b2a', 'request_id': 'req-5ad81eef-b695-4e96-8581-a3323d428a18'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:59.499708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43a0ef05235463a9b74c4fbda933b2a', 'request_id': 'req-5ad81eef-b695-4e96-8581-a3323d428a18'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:59.510646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] The token cache is being invalidate because project a43a0ef05235463a9b74c4fbda933b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:39:59.510874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:59.511546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ad81eef-b695-4e96-8581-a3323d428a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:39:59.513027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1191/2364] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:39:59 2022] DELETE /identity/v3/projects/a43a0ef05235463a9b74c4fbda933b2a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:39:59.518256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f312d-5c5a-4bbf-9320-0be5effefd30 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.518772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f312d-5c5a-4bbf-9320-0be5effefd30 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.518882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f312d-5c5a-4bbf-9320-0be5effefd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.538491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5c0f312d-5c5a-4bbf-9320-0be5effefd30 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:59.539675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5c0f312d-5c5a-4bbf-9320-0be5effefd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:59.596588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1174/2365] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:59.604737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42afe7-3e7d-403e-ba97-5f2c4dad0acd None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.605019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42afe7-3e7d-403e-ba97-5f2c4dad0acd None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.605286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42afe7-3e7d-403e-ba97-5f2c4dad0acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.624275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-df42afe7-3e7d-403e-ba97-5f2c4dad0acd None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:39:59.625464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-df42afe7-3e7d-403e-ba97-5f2c4dad0acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:39:59.633741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1192/2366] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:39:59.637828 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f312d-5c5a-4bbf-9320-0be5effefd30 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:59.644139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:59.647951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f312d-5c5a-4bbf-9320-0be5effefd30 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:59.652623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:59.653229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.653513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.653827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.654480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:39:59.654814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:59.656451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:59.668592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1175/2367] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:39:59.672741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42afe7-3e7d-403e-ba97-5f2c4dad0acd None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:59.682973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42afe7-3e7d-403e-ba97-5f2c4dad0acd None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:59.687679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06565-91a1-47a3-a7db-eb3e89756984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:59.688313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06565-91a1-47a3-a7db-eb3e89756984 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.688600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06565-91a1-47a3-a7db-eb3e89756984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.688877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a06565-91a1-47a3-a7db-eb3e89756984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.689508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06565-91a1-47a3-a7db-eb3e89756984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:59.691439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a06565-91a1-47a3-a7db-eb3e89756984 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:59.707026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:59.773883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1193/2368] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:39:59 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:39:59.777992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:59.788488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b5375-b569-4864-9861-d80719d27450 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:59.843588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a27be-efa1-46bb-b5bf-18e45c937206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:59.844187 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a27be-efa1-46bb-b5bf-18e45c937206 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.844472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a27be-efa1-46bb-b5bf-18e45c937206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.844744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a27be-efa1-46bb-b5bf-18e45c937206 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.845362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a27be-efa1-46bb-b5bf-18e45c937206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:59.847371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a27be-efa1-46bb-b5bf-18e45c937206 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:59.947002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1176/2369] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:39:59 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:39:59.951075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06565-91a1-47a3-a7db-eb3e89756984 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:59.961889 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a06565-91a1-47a3-a7db-eb3e89756984 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:59.966475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf61f-4ab4-46ba-9dcb-36235b458c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:59.967062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf61f-4ab4-46ba-9dcb-36235b458c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.967340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf61f-4ab4-46ba-9dcb-36235b458c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:39:59.967611 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf61f-4ab4-46ba-9dcb-36235b458c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:39:59.968378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcf61f-4ab4-46ba-9dcb-36235b458c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:39:59.970039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcf61f-4ab4-46ba-9dcb-36235b458c3d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:39:59.980388 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1194/2370] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:39:59.984469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a27be-efa1-46bb-b5bf-18e45c937206 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:39:59.994213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a27be-efa1-46bb-b5bf-18e45c937206 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:39:59.998878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ac680-b307-436f-b9a9-233fd3d25682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:39:59.999459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ac680-b307-436f-b9a9-233fd3d25682 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:39:59.999739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ac680-b307-436f-b9a9-233fd3d25682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.000052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ac680-b307-436f-b9a9-233fd3d25682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.000687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ac680-b307-436f-b9a9-233fd3d25682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:00.002300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ac680-b307-436f-b9a9-233fd3d25682 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:00.012784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1177/2371] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:00.017041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf61f-4ab4-46ba-9dcb-36235b458c3d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:00.027571 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf61f-4ab4-46ba-9dcb-36235b458c3d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:00.032198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6de3a-21bc-43d1-9ff4-d9b97e373363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:00.032842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6de3a-21bc-43d1-9ff4-d9b97e373363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.033120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6de3a-21bc-43d1-9ff4-d9b97e373363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.033391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6de3a-21bc-43d1-9ff4-d9b97e373363 admin admin] PATH_INFO: `/v3/projects/fec892d934494241a365793eb5d28e08/users/deba550465ce4a7695bde4f3c434f6fe/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.049456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6de3a-21bc-43d1-9ff4-d9b97e373363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec892d934494241a365793eb5d28e08, user_id=deba550465ce4a7695bde4f3c434f6fe, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:00.052228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6de3a-21bc-43d1-9ff4-d9b97e373363 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:00.148753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1195/2372] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:40:00 2022] PUT /identity/v3/projects/fec892d934494241a365793eb5d28e08/users/deba550465ce4a7695bde4f3c434f6fe/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:00.160041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef00a-3705-48c9-b77e-952e9fdeb058 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.160331 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef00a-3705-48c9-b77e-952e9fdeb058 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.160656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef00a-3705-48c9-b77e-952e9fdeb058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.187779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-21aef00a-3705-48c9-b77e-952e9fdeb058 None None] MFA Rules not processed for user `deba550465ce4a7695bde4f3c434f6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:00.188978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-21aef00a-3705-48c9-b77e-952e9fdeb058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:00.252549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1178/2373] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:00.257545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6de3a-21bc-43d1-9ff4-d9b97e373363 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:00.318540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6de3a-21bc-43d1-9ff4-d9b97e373363 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:00.323120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61f0f-e71b-49b8-aa9e-6fc4a9a66f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:00.323722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61f0f-e71b-49b8-aa9e-6fc4a9a66f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.324009 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61f0f-e71b-49b8-aa9e-6fc4a9a66f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.324285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d61f0f-e71b-49b8-aa9e-6fc4a9a66f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.324903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d61f0f-e71b-49b8-aa9e-6fc4a9a66f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:00.326849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d61f0f-e71b-49b8-aa9e-6fc4a9a66f2c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:00.445243 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1196/2374] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:40:00 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:00.448779 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aef00a-3705-48c9-b77e-952e9fdeb058 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:00.460309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aef00a-3705-48c9-b77e-952e9fdeb058 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:00.515173 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00bfdc-4998-4e7b-b967-db340a868040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:00.515771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00bfdc-4998-4e7b-b967-db340a868040 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.516052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00bfdc-4998-4e7b-b967-db340a868040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.516325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00bfdc-4998-4e7b-b967-db340a868040 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.516951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00bfdc-4998-4e7b-b967-db340a868040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:00.518910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00bfdc-4998-4e7b-b967-db340a868040 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:00.527110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:00.599215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1179/2375] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:40:00 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:00.604608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61f0f-e71b-49b8-aa9e-6fc4a9a66f2c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:00.613751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d61f0f-e71b-49b8-aa9e-6fc4a9a66f2c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:00.618330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c367e-3a99-4552-9185-b4b2ed3540fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:00.618918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c367e-3a99-4552-9185-b4b2ed3540fc admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.619195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c367e-3a99-4552-9185-b4b2ed3540fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.619466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c367e-3a99-4552-9185-b4b2ed3540fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.620103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c367e-3a99-4552-9185-b4b2ed3540fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:00.621724 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c367e-3a99-4552-9185-b4b2ed3540fc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:00.632887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1197/2376] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:00.637091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00bfdc-4998-4e7b-b967-db340a868040 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:00.648065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00bfdc-4998-4e7b-b967-db340a868040 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:00.652711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1166e1-467e-4738-85fd-32d6b860fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:00.653361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1166e1-467e-4738-85fd-32d6b860fb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.653681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1166e1-467e-4738-85fd-32d6b860fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.653961 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1166e1-467e-4738-85fd-32d6b860fb41 admin admin] PATH_INFO: `/v3/projects/cdbd363b41dd43cfa38541f1cf120418/users/f7365e878ac643afa72bd7cbf18135a2/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.669220 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1166e1-467e-4738-85fd-32d6b860fb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbd363b41dd43cfa38541f1cf120418, user_id=f7365e878ac643afa72bd7cbf18135a2, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:00.671974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1166e1-467e-4738-85fd-32d6b860fb41 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:00.724349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1180/2377] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:40:00 2022] PUT /identity/v3/projects/cdbd363b41dd43cfa38541f1cf120418/users/f7365e878ac643afa72bd7cbf18135a2/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:00.728303 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c367e-3a99-4552-9185-b4b2ed3540fc admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:00.738472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c367e-3a99-4552-9185-b4b2ed3540fc admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:00.795495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1d0c3-7f80-439a-88be-cd9a1e56fb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:00.796109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1d0c3-7f80-439a-88be-cd9a1e56fb13 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.796393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1d0c3-7f80-439a-88be-cd9a1e56fb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.796686 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1d0c3-7f80-439a-88be-cd9a1e56fb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.797315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1d0c3-7f80-439a-88be-cd9a1e56fb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:00.798990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1d0c3-7f80-439a-88be-cd9a1e56fb13 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:00.808862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1198/2378] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:00.812817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1166e1-467e-4738-85fd-32d6b860fb41 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:00.823756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1166e1-467e-4738-85fd-32d6b860fb41 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:00.828445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:00.829079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.829363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.829660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] PATH_INFO: `/v3/projects/cdbd363b41dd43cfa38541f1cf120418/users/f7365e878ac643afa72bd7cbf18135a2/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.831524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbd363b41dd43cfa38541f1cf120418, user_id=f7365e878ac643afa72bd7cbf18135a2, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:00.834730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:00.844654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1181/2379] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:40:00 2022] PUT /identity/v3/projects/cdbd363b41dd43cfa38541f1cf120418/users/f7365e878ac643afa72bd7cbf18135a2/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:00.856788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e46ed-45c9-478e-9585-409ea4fd3102 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:00.856788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e46ed-45c9-478e-9585-409ea4fd3102 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:00.856788 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e46ed-45c9-478e-9585-409ea4fd3102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:00.882730 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-213e46ed-45c9-478e-9585-409ea4fd3102 None None] MFA Rules not processed for user `f7365e878ac643afa72bd7cbf18135a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:00.883974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-213e46ed-45c9-478e-9585-409ea4fd3102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:00.903047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:00.953092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1199/2380] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:00.964342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:00.966032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:01.024219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39820-4b96-4cf6-8280-a459006f14c5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:01.027863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2031e99-3a53-42cf-a015-d561e0f6c8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:01.028474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2031e99-3a53-42cf-a015-d561e0f6c8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:01.028753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2031e99-3a53-42cf-a015-d561e0f6c8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:01.029046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2031e99-3a53-42cf-a015-d561e0f6c8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:01.039010 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2031e99-3a53-42cf-a015-d561e0f6c8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:01.045465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2031e99-3a53-42cf-a015-d561e0f6c8d3 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:01.049812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1182/2381] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:01.079156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e46ed-45c9-478e-9585-409ea4fd3102 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:01.140346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e46ed-45c9-478e-9585-409ea4fd3102 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:01.144859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:01.146051 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:01.146337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:01.146614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] PATH_INFO: `/v3/users/deba550465ce4a7695bde4f3c434f6fe` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:01.147743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=deba550465ce4a7695bde4f3c434f6fe)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:01.149731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:01.292364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deba550465ce4a7695bde4f3c434f6fe'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:01.293034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deba550465ce4a7695bde4f3c434f6fe'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:01.293682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deba550465ce4a7695bde4f3c434f6fe'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:01.344845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deba550465ce4a7695bde4f3c434f6fe'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:01.357060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deba550465ce4a7695bde4f3c434f6fe'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:01.369770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1200/2382] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:40:01 2022] DELETE /identity/v3/users/deba550465ce4a7695bde4f3c434f6fe => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:01.374274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747da135-1190-41ac-b4f5-1096518035f6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:01.374565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747da135-1190-41ac-b4f5-1096518035f6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:01.374840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747da135-1190-41ac-b4f5-1096518035f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:01.394297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-747da135-1190-41ac-b4f5-1096518035f6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:01.395444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-747da135-1190-41ac-b4f5-1096518035f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:01.452226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1183/2383] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:01.461936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:01.463359 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:01.506228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:01.523801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4a733-65de-42c8-80a0-3850f8b623ae admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:01.527583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d955470-9c65-4143-9090-3da9daf7dd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:01.528191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d955470-9c65-4143-9090-3da9daf7dd0b service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:01.528475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d955470-9c65-4143-9090-3da9daf7dd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:01.528774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d955470-9c65-4143-9090-3da9daf7dd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:01.537798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d955470-9c65-4143-9090-3da9daf7dd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:01.539313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d955470-9c65-4143-9090-3da9daf7dd0b service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:01.549579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1201/2384] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:01.966124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747da135-1190-41ac-b4f5-1096518035f6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:01.967753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-747da135-1190-41ac-b4f5-1096518035f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:01.980725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747da135-1190-41ac-b4f5-1096518035f6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:01.985332 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:01.985997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:01.986278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:01.986552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] PATH_INFO: `/v3/projects/fec892d934494241a365793eb5d28e08` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:01.987716 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec892d934494241a365793eb5d28e08)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:01.989683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:02.094859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec892d934494241a365793eb5d28e08', 'request_id': 'req-3912c124-cbeb-44a4-9a6f-a457ab7c289b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.096515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:02.185162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec892d934494241a365793eb5d28e08', 'request_id': 'req-3912c124-cbeb-44a4-9a6f-a457ab7c289b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.191571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec892d934494241a365793eb5d28e08', 'request_id': 'req-3912c124-cbeb-44a4-9a6f-a457ab7c289b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.201733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] The token cache is being invalidate because project fec892d934494241a365793eb5d28e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:40:02.202023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.202648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.204127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1184/2385] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:40:01 2022] DELETE /identity/v3/projects/fec892d934494241a365793eb5d28e08 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:02.208746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d955470-9c65-4143-9090-3da9daf7dd0b service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:02.218833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d955470-9c65-4143-9090-3da9daf7dd0b service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:02.276195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:02.276826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:02.277109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:02.277384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] PATH_INFO: `/v3/users/f7365e878ac643afa72bd7cbf18135a2` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:02.278559 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7365e878ac643afa72bd7cbf18135a2)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:02.280477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:02.425481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:02.426951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:02.500233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912c124-cbeb-44a4-9a6f-a457ab7c289b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:02.506843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:02.507456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:02.507743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:02.508019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:02.509777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:02.511524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7365e878ac643afa72bd7cbf18135a2'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.512173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7365e878ac643afa72bd7cbf18135a2'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.512785 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7365e878ac643afa72bd7cbf18135a2'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.567815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:02.569548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:02.581324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7365e878ac643afa72bd7cbf18135a2'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.584688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1185/2386] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:40:02.595341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0463a564-8ec9-4f89-b772-c3249529413b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7365e878ac643afa72bd7cbf18135a2'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:02.608782 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1202/2387] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:40:02 2022] DELETE /identity/v3/users/f7365e878ac643afa72bd7cbf18135a2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:03.057216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:03.058860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:03.073367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f718d20-941a-41a6-b813-a9e808a11ab7 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:03.131977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:03.132588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.132869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.133143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] PATH_INFO: `/v3/projects/cdbd363b41dd43cfa38541f1cf120418` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.134275 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdbd363b41dd43cfa38541f1cf120418)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:03.136184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:03.152587 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:03.248851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdbd363b41dd43cfa38541f1cf120418', 'request_id': 'req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:03.356539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdbd363b41dd43cfa38541f1cf120418', 'request_id': 'req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:03.363292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdbd363b41dd43cfa38541f1cf120418', 'request_id': 'req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:03.374353 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] The token cache is being invalidate because project cdbd363b41dd43cfa38541f1cf120418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:40:03.374643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:03.375303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-13f413bb-6e57-4e5d-80c3-cb0ece4126f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:03.376788 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1186/2388] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:40:03 2022] DELETE /identity/v3/projects/cdbd363b41dd43cfa38541f1cf120418 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:03.382625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee6ec-c5db-4ddc-843b-3c8ba16cbf92 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.383916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee6ec-c5db-4ddc-843b-3c8ba16cbf92 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.383916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee6ec-c5db-4ddc-843b-3c8ba16cbf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.402656 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-756ee6ec-c5db-4ddc-843b-3c8ba16cbf92 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:03.403857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-756ee6ec-c5db-4ddc-843b-3c8ba16cbf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:03.454371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:03.464362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1203/2389] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:03.472344 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77ade-c417-4735-bfe1-a025e9f5183b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.472629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77ade-c417-4735-bfe1-a025e9f5183b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.472951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77ade-c417-4735-bfe1-a025e9f5183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.494128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-27d77ade-c417-4735-bfe1-a025e9f5183b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:03.495325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-27d77ade-c417-4735-bfe1-a025e9f5183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:03.503235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1187/2390] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:03.507564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee6ec-c5db-4ddc-843b-3c8ba16cbf92 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:03.517987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee6ec-c5db-4ddc-843b-3c8ba16cbf92 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:03.523409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:03.524028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.524314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.524587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.525260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:40:03.525541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:03.527171 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:03.538771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1204/2391] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:40:03.543092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d77ade-c417-4735-bfe1-a025e9f5183b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:03.552891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d77ade-c417-4735-bfe1-a025e9f5183b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:03.557559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04597cb2-4b93-4805-9f33-c90732c272fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:03.566516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04597cb2-4b93-4805-9f33-c90732c272fb admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.566516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04597cb2-4b93-4805-9f33-c90732c272fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.566516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04597cb2-4b93-4805-9f33-c90732c272fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.566516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04597cb2-4b93-4805-9f33-c90732c272fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:03.566516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04597cb2-4b93-4805-9f33-c90732c272fb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:03.667778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1188/2392] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:40:03 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:40:03.672241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:03.683544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b280b3-bf85-4682-92c6-ee2a001f18be admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:03.737482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e54e9c-24ff-4f62-a2cc-ec7832fb51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:03.738108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54e9c-24ff-4f62-a2cc-ec7832fb51df admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.738385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54e9c-24ff-4f62-a2cc-ec7832fb51df admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.738654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54e9c-24ff-4f62-a2cc-ec7832fb51df admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.739853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e54e9c-24ff-4f62-a2cc-ec7832fb51df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:03.741738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e54e9c-24ff-4f62-a2cc-ec7832fb51df admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:03.821367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1205/2393] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:40:03 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:03.825570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04597cb2-4b93-4805-9f33-c90732c272fb admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:03.835714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04597cb2-4b93-4805-9f33-c90732c272fb admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:03.840192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98075-d9a8-40f1-be13-3b01b3454c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:03.840781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98075-d9a8-40f1-be13-3b01b3454c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.841059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98075-d9a8-40f1-be13-3b01b3454c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.841328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b98075-d9a8-40f1-be13-3b01b3454c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.842005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b98075-d9a8-40f1-be13-3b01b3454c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:03.843565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b98075-d9a8-40f1-be13-3b01b3454c39 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:03.854186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1189/2394] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:03.858121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e54e9c-24ff-4f62-a2cc-ec7832fb51df admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:03.868457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e54e9c-24ff-4f62-a2cc-ec7832fb51df admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:03.873122 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1993d5-401b-4249-8108-8c88e4e65890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:03.873741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1993d5-401b-4249-8108-8c88e4e65890 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.874024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1993d5-401b-4249-8108-8c88e4e65890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.874292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1993d5-401b-4249-8108-8c88e4e65890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.874923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1993d5-401b-4249-8108-8c88e4e65890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:03.876527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1993d5-401b-4249-8108-8c88e4e65890 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:03.886220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1206/2395] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:40:03.890715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98075-d9a8-40f1-be13-3b01b3454c39 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:03.900446 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b98075-d9a8-40f1-be13-3b01b3454c39 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:03.905043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5366-007f-4db1-8d52-2021dbaacd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:03.905721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5366-007f-4db1-8d52-2021dbaacd70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:03.906006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5366-007f-4db1-8d52-2021dbaacd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:03.906280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5366-007f-4db1-8d52-2021dbaacd70 admin admin] PATH_INFO: `/v3/projects/76864300ecc148889303a04348ed86cc/users/1c5a8f0ca605443ea68687b063e529f8/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:03.921018 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe5366-007f-4db1-8d52-2021dbaacd70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76864300ecc148889303a04348ed86cc, user_id=1c5a8f0ca605443ea68687b063e529f8, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:03.923688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe5366-007f-4db1-8d52-2021dbaacd70 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:04.009843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1190/2396] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:40:03 2022] PUT /identity/v3/projects/76864300ecc148889303a04348ed86cc/users/1c5a8f0ca605443ea68687b063e529f8/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:04.021395 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340230-8243-4d00-9aed-dc197824f741 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.021716 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340230-8243-4d00-9aed-dc197824f741 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.021996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50340230-8243-4d00-9aed-dc197824f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.050211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-50340230-8243-4d00-9aed-dc197824f741 None None] MFA Rules not processed for user `1c5a8f0ca605443ea68687b063e529f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:04.052003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-50340230-8243-4d00-9aed-dc197824f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:04.117955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1207/2397] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:04.122533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5366-007f-4db1-8d52-2021dbaacd70 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:04.184927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5366-007f-4db1-8d52-2021dbaacd70 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:04.189676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fc588-6c65-487f-abe2-f42351dc6f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:04.190278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fc588-6c65-487f-abe2-f42351dc6f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.190564 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fc588-6c65-487f-abe2-f42351dc6f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.190860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fc588-6c65-487f-abe2-f42351dc6f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.191467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fc588-6c65-487f-abe2-f42351dc6f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:04.193948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fc588-6c65-487f-abe2-f42351dc6f9d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:04.279327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1191/2398] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:40:04 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:04.283169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50340230-8243-4d00-9aed-dc197824f741 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:04.293850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50340230-8243-4d00-9aed-dc197824f741 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:04.341129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:04.349451 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e87f9-6d48-408c-b505-8b2b204edab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:04.353435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e87f9-6d48-408c-b505-8b2b204edab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.353435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e87f9-6d48-408c-b505-8b2b204edab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.353435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e87f9-6d48-408c-b505-8b2b204edab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.353435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e87f9-6d48-408c-b505-8b2b204edab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:04.353435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e87f9-6d48-408c-b505-8b2b204edab6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:04.466061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1208/2399] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:40:04 2022] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:04.471006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fc588-6c65-487f-abe2-f42351dc6f9d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:04.481963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fc588-6c65-487f-abe2-f42351dc6f9d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:04.486484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee16fcf-2a96-4838-9676-53c9e6865fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:04.487089 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee16fcf-2a96-4838-9676-53c9e6865fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.487370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee16fcf-2a96-4838-9676-53c9e6865fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.487644 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee16fcf-2a96-4838-9676-53c9e6865fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.488284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee16fcf-2a96-4838-9676-53c9e6865fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:04.489908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee16fcf-2a96-4838-9676-53c9e6865fcf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:04.500348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1192/2400] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:04.504597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e87f9-6d48-408c-b505-8b2b204edab6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:04.515014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e87f9-6d48-408c-b505-8b2b204edab6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:04.519697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c58e-32e0-4a1c-b83e-9725c9a3f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:04.520935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c58e-32e0-4a1c-b83e-9725c9a3f38c admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.521242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c58e-32e0-4a1c-b83e-9725c9a3f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.521511 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0c58e-32e0-4a1c-b83e-9725c9a3f38c admin admin] PATH_INFO: `/v3/projects/4c92e43fcc484cb78ff8eba90460ab5b/users/38acad5623fd430e87a07a260043d0be/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.536693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0c58e-32e0-4a1c-b83e-9725c9a3f38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c92e43fcc484cb78ff8eba90460ab5b, user_id=38acad5623fd430e87a07a260043d0be, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:04.539387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0c58e-32e0-4a1c-b83e-9725c9a3f38c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:04.648508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1209/2401] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:40:04 2022] PUT /identity/v3/projects/4c92e43fcc484cb78ff8eba90460ab5b/users/38acad5623fd430e87a07a260043d0be/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:04.652505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee16fcf-2a96-4838-9676-53c9e6865fcf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:04.662778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee16fcf-2a96-4838-9676-53c9e6865fcf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:04.674398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:04.719502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06499068-3bea-422f-b4ca-286a9d1d251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:04.720033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499068-3bea-422f-b4ca-286a9d1d251b admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.720323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499068-3bea-422f-b4ca-286a9d1d251b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.720600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499068-3bea-422f-b4ca-286a9d1d251b admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.721238 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06499068-3bea-422f-b4ca-286a9d1d251b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:04.722901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06499068-3bea-422f-b4ca-286a9d1d251b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:04.732783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1193/2402] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:04.736960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c58e-32e0-4a1c-b83e-9725c9a3f38c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:04.747254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0c58e-32e0-4a1c-b83e-9725c9a3f38c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:04.751990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:04.752634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.752918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.753193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] PATH_INFO: `/v3/projects/4c92e43fcc484cb78ff8eba90460ab5b/users/38acad5623fd430e87a07a260043d0be/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.755664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c92e43fcc484cb78ff8eba90460ab5b, user_id=38acad5623fd430e87a07a260043d0be, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:04.758318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:04.768530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1210/2403] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:40:04 2022] PUT /identity/v3/projects/4c92e43fcc484cb78ff8eba90460ab5b/users/38acad5623fd430e87a07a260043d0be/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:04.778495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbcfb-0b0e-477f-888a-a5929d1de760 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.778790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbcfb-0b0e-477f-888a-a5929d1de760 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.779071 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbcfb-0b0e-477f-888a-a5929d1de760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.807105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-499cbcfb-0b0e-477f-888a-a5929d1de760 None None] MFA Rules not processed for user `38acad5623fd430e87a07a260043d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:04.808307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-499cbcfb-0b0e-477f-888a-a5929d1de760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:04.876515 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1194/2404] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:40:04.887504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:04.889281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:04.951010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2c296-be93-48a0-a74c-89b1a308f737 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:04.954713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d09ad-a068-4c14-bc84-d8a2762a460a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:04.955319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d09ad-a068-4c14-bc84-d8a2762a460a service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:04.955602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d09ad-a068-4c14-bc84-d8a2762a460a service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:04.955876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d09ad-a068-4c14-bc84-d8a2762a460a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:04.966047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d09ad-a068-4c14-bc84-d8a2762a460a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:04.967524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d09ad-a068-4c14-bc84-d8a2762a460a service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:04.977852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1211/2405] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:04 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:05.131529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cbcfb-0b0e-477f-888a-a5929d1de760 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:05.195292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cbcfb-0b0e-477f-888a-a5929d1de760 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:05.199842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:05.200477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:05.200781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:05.201060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] PATH_INFO: `/v3/users/1c5a8f0ca605443ea68687b063e529f8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:05.202205 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5a8f0ca605443ea68687b063e529f8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:05.204128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:05.360042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:05.366384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5a8f0ca605443ea68687b063e529f8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:05.373345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5a8f0ca605443ea68687b063e529f8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:05.374036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5a8f0ca605443ea68687b063e529f8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:05.374652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5a8f0ca605443ea68687b063e529f8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:05.386526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5a8f0ca605443ea68687b063e529f8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:05.491659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1195/2406] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:40:05 2022] DELETE /identity/v3/users/1c5a8f0ca605443ea68687b063e529f8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:05.497455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f49405-c478-49fc-84c7-475a8fc45eed None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:05.497791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f49405-c478-49fc-84c7-475a8fc45eed None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:05.498094 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f49405-c478-49fc-84c7-475a8fc45eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:05.523710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-51f49405-c478-49fc-84c7-475a8fc45eed None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:05.523710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-51f49405-c478-49fc-84c7-475a8fc45eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:05.585166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1212/2407] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:05.594882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:05.596514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:05.653359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b42bf-0c14-4e56-b7a6-cb8b105d2ad5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:05.656944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eb245-c77a-40ae-aa51-53d90ae00878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:05.657541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb245-c77a-40ae-aa51-53d90ae00878 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:05.657865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb245-c77a-40ae-aa51-53d90ae00878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:05.658141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36eb245-c77a-40ae-aa51-53d90ae00878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:05.667443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36eb245-c77a-40ae-aa51-53d90ae00878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:05.668870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36eb245-c77a-40ae-aa51-53d90ae00878 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:05.679324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1196/2408] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:40:06.137188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f49405-c478-49fc-84c7-475a8fc45eed None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:06.142156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-51f49405-c478-49fc-84c7-475a8fc45eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:06.156754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f49405-c478-49fc-84c7-475a8fc45eed None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:06.163056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:06.163698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:06.163986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:06.164296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] PATH_INFO: `/v3/projects/76864300ecc148889303a04348ed86cc` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:06.165466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76864300ecc148889303a04348ed86cc)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:06.167367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:06.269489 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:06.272947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76864300ecc148889303a04348ed86cc', 'request_id': 'req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.279242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76864300ecc148889303a04348ed86cc', 'request_id': 'req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.369378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76864300ecc148889303a04348ed86cc', 'request_id': 'req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.380079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] The token cache is being invalidate because project 76864300ecc148889303a04348ed86cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:40:06.380475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.381502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.383043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1213/2409] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:40:06 2022] DELETE /identity/v3/projects/76864300ecc148889303a04348ed86cc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:06.387129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eb245-c77a-40ae-aa51-53d90ae00878 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:06.396878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36eb245-c77a-40ae-aa51-53d90ae00878 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:06.452684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:06.453305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:06.453584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:06.453887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] PATH_INFO: `/v3/users/38acad5623fd430e87a07a260043d0be` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:06.454986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38acad5623fd430e87a07a260043d0be)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:06.456896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:06.654601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38acad5623fd430e87a07a260043d0be'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.654601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38acad5623fd430e87a07a260043d0be'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.654601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38acad5623fd430e87a07a260043d0be'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.654601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38acad5623fd430e87a07a260043d0be'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.658324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:06.667360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-45c3a317-f4db-49db-b910-c99a10501b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38acad5623fd430e87a07a260043d0be'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:06.741755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1197/2410] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:40:06 2022] DELETE /identity/v3/users/38acad5623fd430e87a07a260043d0be => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:07.119972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:07.122366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:07.135984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2938d-2f8d-455e-8df3-f2dfccd6ded6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:07.194137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:07.194691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.194971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.195242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] PATH_INFO: `/v3/projects/4c92e43fcc484cb78ff8eba90460ab5b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.196346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c92e43fcc484cb78ff8eba90460ab5b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:07.198372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:07.295252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c92e43fcc484cb78ff8eba90460ab5b', 'request_id': 'req-4ac0faa1-78ea-4c45-ab12-699837d1e327'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:07.301381 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c92e43fcc484cb78ff8eba90460ab5b', 'request_id': 'req-4ac0faa1-78ea-4c45-ab12-699837d1e327'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:07.363240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c92e43fcc484cb78ff8eba90460ab5b', 'request_id': 'req-4ac0faa1-78ea-4c45-ab12-699837d1e327'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:07.374025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] The token cache is being invalidate because project 4c92e43fcc484cb78ff8eba90460ab5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:40:07.374905 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:07.375154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4ac0faa1-78ea-4c45-ab12-699837d1e327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:07.376541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1214/2411] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:40:07 2022] DELETE /identity/v3/projects/4c92e43fcc484cb78ff8eba90460ab5b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:07.381439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf336e3c-61ba-4f05-a561-11b74ff0fbf6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.381765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf336e3c-61ba-4f05-a561-11b74ff0fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.382041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf336e3c-61ba-4f05-a561-11b74ff0fbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.402268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cf336e3c-61ba-4f05-a561-11b74ff0fbf6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:07.403481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cf336e3c-61ba-4f05-a561-11b74ff0fbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:07.460834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1198/2412] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:07.468630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6818d4-c188-4f96-af27-257224e7c4f2 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.468917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6818d4-c188-4f96-af27-257224e7c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.469193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6818d4-c188-4f96-af27-257224e7c4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.489293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ea6818d4-c188-4f96-af27-257224e7c4f2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:07.490501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ea6818d4-c188-4f96-af27-257224e7c4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:07.498211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1215/2413] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:07.502268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf336e3c-61ba-4f05-a561-11b74ff0fbf6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:07.512317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf336e3c-61ba-4f05-a561-11b74ff0fbf6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:07.517487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:07.518124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.518409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.518684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.519364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:40:07.519756 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:07.521419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:07.532863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1199/2414] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:40:07.537045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6818d4-c188-4f96-af27-257224e7c4f2 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:07.546193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6818d4-c188-4f96-af27-257224e7c4f2 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:07.550819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7475e-fd55-4afb-a816-71a90dbe890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:07.551916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7475e-fd55-4afb-a816-71a90dbe890a admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.552198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7475e-fd55-4afb-a816-71a90dbe890a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.552473 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7475e-fd55-4afb-a816-71a90dbe890a admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.553093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7475e-fd55-4afb-a816-71a90dbe890a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:07.555016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7475e-fd55-4afb-a816-71a90dbe890a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:07.639184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1216/2415] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:40:07 2022] POST /identity/v3/projects => generated 361 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:07.644218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:07.654271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b95b-2ec2-4e83-8b89-8d9ebae2b4b6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:07.709570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a05d-c8e3-4e97-940a-01f65701b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:07.710208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a05d-c8e3-4e97-940a-01f65701b058 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.710492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a05d-c8e3-4e97-940a-01f65701b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.710769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a05d-c8e3-4e97-940a-01f65701b058 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.711444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6a05d-c8e3-4e97-940a-01f65701b058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:07.713307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6a05d-c8e3-4e97-940a-01f65701b058 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:07.768885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1200/2416] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:40:07 2022] POST /identity/v3/users => generated 281 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:07.772971 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7475e-fd55-4afb-a816-71a90dbe890a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:07.783577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7475e-fd55-4afb-a816-71a90dbe890a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:07.789078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ac9f2-acd6-41f5-bd7f-3a040df9ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:07.789721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac9f2-acd6-41f5-bd7f-3a040df9ac77 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.790011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac9f2-acd6-41f5-bd7f-3a040df9ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.790289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ac9f2-acd6-41f5-bd7f-3a040df9ac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.790943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ac9f2-acd6-41f5-bd7f-3a040df9ac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:07.792556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ac9f2-acd6-41f5-bd7f-3a040df9ac77 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:07.803535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1217/2417] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:07.812697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a05d-c8e3-4e97-940a-01f65701b058 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:07.822582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a05d-c8e3-4e97-940a-01f65701b058 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:07.827247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931883a-a7e5-4900-8b98-e71453a54774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:07.827843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931883a-a7e5-4900-8b98-e71453a54774 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.828124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931883a-a7e5-4900-8b98-e71453a54774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.828400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931883a-a7e5-4900-8b98-e71453a54774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.829040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931883a-a7e5-4900-8b98-e71453a54774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:07.830686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931883a-a7e5-4900-8b98-e71453a54774 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:07.841284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1201/2418] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:07.845422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ac9f2-acd6-41f5-bd7f-3a040df9ac77 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:07.855926 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ac9f2-acd6-41f5-bd7f-3a040df9ac77 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:07.860533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:07.861182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.861464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.861773 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] PATH_INFO: `/v3/projects/ba90e65450ef4134b7d3f224b9af8340/users/64265aa772a04917b7a0e7fd5e4a902a/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.877544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba90e65450ef4134b7d3f224b9af8340, user_id=64265aa772a04917b7a0e7fd5e4a902a, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:07.880252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:07.941630 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:07.947485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1218/2419] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:40:07 2022] PUT /identity/v3/projects/ba90e65450ef4134b7d3f224b9af8340/users/64265aa772a04917b7a0e7fd5e4a902a/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:40:07.959104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7208a2-e7d1-48cf-94ee-746feb769e6f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:07.959477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7208a2-e7d1-48cf-94ee-746feb769e6f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:07.959783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7208a2-e7d1-48cf-94ee-746feb769e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:07.990982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7b7208a2-e7d1-48cf-94ee-746feb769e6f None None] MFA Rules not processed for user `64265aa772a04917b7a0e7fd5e4a902a`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:07.990982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7b7208a2-e7d1-48cf-94ee-746feb769e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:08.021583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:08.052869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1202/2420] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:40:08.089781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:08.091470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:08.149367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576735b-51fb-4f69-b628-dc8cbe9086c6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:08.153143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba2579-66bc-42f2-bc0c-98a857379ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:08.153827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2579-66bc-42f2-bc0c-98a857379ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:08.154108 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2579-66bc-42f2-bc0c-98a857379ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:08.154384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2579-66bc-42f2-bc0c-98a857379ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:08.162700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba2579-66bc-42f2-bc0c-98a857379ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:08.164165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba2579-66bc-42f2-bc0c-98a857379ed1 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:08.174967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1219/2421] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:08.190544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7208a2-e7d1-48cf-94ee-746feb769e6f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:08.251952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7208a2-e7d1-48cf-94ee-746feb769e6f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:08.256960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:08.257581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:08.257893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:08.258166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] PATH_INFO: `/v3/users/64265aa772a04917b7a0e7fd5e4a902a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:08.259294 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64265aa772a04917b7a0e7fd5e4a902a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:08.261195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:08.456808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64265aa772a04917b7a0e7fd5e4a902a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:08.463724 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64265aa772a04917b7a0e7fd5e4a902a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:08.464376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64265aa772a04917b7a0e7fd5e4a902a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:08.465059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64265aa772a04917b7a0e7fd5e4a902a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:08.477721 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64265aa772a04917b7a0e7fd5e4a902a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:08.557580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1203/2422] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:40:08 2022] DELETE /identity/v3/users/64265aa772a04917b7a0e7fd5e4a902a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:08.561932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664f85-2333-4467-abea-5d8418f55e2b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:08.562227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664f85-2333-4467-abea-5d8418f55e2b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:08.562508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664f85-2333-4467-abea-5d8418f55e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:08.580947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-a5664f85-2333-4467-abea-5d8418f55e2b None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:08.582255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a5664f85-2333-4467-abea-5d8418f55e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:08.640239 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1220/2423] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:08.649857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:08.651251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:08.710302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b2ae7-4f79-4449-8fcc-9dd6882fcb13 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:08.713928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb6dfb-4c8d-47fb-b722-f22f48decd18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:08.714578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6dfb-4c8d-47fb-b722-f22f48decd18 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:08.714853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6dfb-4c8d-47fb-b722-f22f48decd18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:08.715121 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6dfb-4c8d-47fb-b722-f22f48decd18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:08.722058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:08.724805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb6dfb-4c8d-47fb-b722-f22f48decd18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:08.726272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb6dfb-4c8d-47fb-b722-f22f48decd18 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:08.735568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1204/2424] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:09.153879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5664f85-2333-4467-abea-5d8418f55e2b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:09.155419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a5664f85-2333-4467-abea-5d8418f55e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:09.168650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5664f85-2333-4467-abea-5d8418f55e2b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:09.173113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:09.173801 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.174090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.175577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] PATH_INFO: `/v3/projects/ba90e65450ef4134b7d3f224b9af8340` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.178402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba90e65450ef4134b7d3f224b9af8340)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:09.180221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:09.287766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba90e65450ef4134b7d3f224b9af8340', 'request_id': 'req-615aea7e-617f-4c1d-b862-6caf6ad23cf6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:09.293882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba90e65450ef4134b7d3f224b9af8340', 'request_id': 'req-615aea7e-617f-4c1d-b862-6caf6ad23cf6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:09.369091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba90e65450ef4134b7d3f224b9af8340', 'request_id': 'req-615aea7e-617f-4c1d-b862-6caf6ad23cf6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:09.380366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] The token cache is being invalidate because project ba90e65450ef4134b7d3f224b9af8340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:40:09.380650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:09.381259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-615aea7e-617f-4c1d-b862-6caf6ad23cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:09.386067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1221/2425] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:40:09 2022] DELETE /identity/v3/projects/ba90e65450ef4134b7d3f224b9af8340 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:09.387692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687497f-13cb-466f-8b6a-a98d9847613d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.387977 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687497f-13cb-466f-8b6a-a98d9847613d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.388255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687497f-13cb-466f-8b6a-a98d9847613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.408211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f687497f-13cb-466f-8b6a-a98d9847613d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:09.409488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f687497f-13cb-466f-8b6a-a98d9847613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:09.467958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1205/2426] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:09.475681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6fd7d-0da9-45bf-be6e-32ea76fd62c8 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.475968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6fd7d-0da9-45bf-be6e-32ea76fd62c8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.476270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6fd7d-0da9-45bf-be6e-32ea76fd62c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.496338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ffe6fd7d-0da9-45bf-be6e-32ea76fd62c8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:09.497530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ffe6fd7d-0da9-45bf-be6e-32ea76fd62c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:09.505989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1222/2427] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:09.510435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687497f-13cb-466f-8b6a-a98d9847613d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:09.520895 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687497f-13cb-466f-8b6a-a98d9847613d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:09.525533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:09.526176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.526460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.526736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.527392 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:40:09.527697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:09.529293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:09.541490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1206/2428] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:40:09.545928 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6fd7d-0da9-45bf-be6e-32ea76fd62c8 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:09.555297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6fd7d-0da9-45bf-be6e-32ea76fd62c8 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:09.560059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd051695-e038-4443-b900-f521e235f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:09.560610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051695-e038-4443-b900-f521e235f43f admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.560915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051695-e038-4443-b900-f521e235f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.561184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd051695-e038-4443-b900-f521e235f43f admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.561848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd051695-e038-4443-b900-f521e235f43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:09.563741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd051695-e038-4443-b900-f521e235f43f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:09.579550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:09.649125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1223/2429] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:40:09 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:09.653335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:09.663945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42312d-4e87-4ac7-805c-999e38d49ac8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:09.720192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7f4e-34f5-410d-807b-9915d793f4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:09.720793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7f4e-34f5-410d-807b-9915d793f4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.721078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7f4e-34f5-410d-807b-9915d793f4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.721355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7f4e-34f5-410d-807b-9915d793f4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.722021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b7f4e-34f5-410d-807b-9915d793f4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:09.724001 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b7f4e-34f5-410d-807b-9915d793f4e1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:09.807418 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1207/2430] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:40:09 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:40:09.817466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd051695-e038-4443-b900-f521e235f43f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:09.827859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd051695-e038-4443-b900-f521e235f43f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:09.833061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a897836-b207-41e9-b63a-b94c7284a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:09.833674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a897836-b207-41e9-b63a-b94c7284a41a admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.833956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a897836-b207-41e9-b63a-b94c7284a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.834225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a897836-b207-41e9-b63a-b94c7284a41a admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.834853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a897836-b207-41e9-b63a-b94c7284a41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:09.836444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a897836-b207-41e9-b63a-b94c7284a41a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:09.846158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1224/2431] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:09.849897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7f4e-34f5-410d-807b-9915d793f4e1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:09.859826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7f4e-34f5-410d-807b-9915d793f4e1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:09.864501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bce427-6720-4ab3-9165-1b9d97a36279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:09.865085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bce427-6720-4ab3-9165-1b9d97a36279 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.865368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bce427-6720-4ab3-9165-1b9d97a36279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.865676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bce427-6720-4ab3-9165-1b9d97a36279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.866327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bce427-6720-4ab3-9165-1b9d97a36279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:09.867908 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bce427-6720-4ab3-9165-1b9d97a36279 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:09.878466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1208/2432] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:09.882888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a897836-b207-41e9-b63a-b94c7284a41a admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:09.892931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a897836-b207-41e9-b63a-b94c7284a41a admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:09.898360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:09.898993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.899322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.899540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] PATH_INFO: `/v3/projects/90ca1d426bc64bd69d3700cb368f4794/users/ca11ea548a94415cadb14f3e5266198b/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:09.913906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ca1d426bc64bd69d3700cb368f4794, user_id=ca11ea548a94415cadb14f3e5266198b, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:09.916562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:09.975172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1225/2433] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:40:09 2022] PUT /identity/v3/projects/90ca1d426bc64bd69d3700cb368f4794/users/ca11ea548a94415cadb14f3e5266198b/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:09.980301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa497b-5a20-474e-91ae-e2dbe7a2167a None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:09.980594 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa497b-5a20-474e-91ae-e2dbe7a2167a None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:09.980880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa497b-5a20-474e-91ae-e2dbe7a2167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:10.000074 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-01fa497b-5a20-474e-91ae-e2dbe7a2167a None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:10.002412 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-01fa497b-5a20-474e-91ae-e2dbe7a2167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:10.061988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1209/2434] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:10.071668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:10.073362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:10.130013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7513a-fcfc-4394-b264-9f2ed4249e2b admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:10.133573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:10.134216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:10.134496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:10.134770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:10.143871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:10.145308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:10.154582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1226/2435] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:11.296236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21396-a8c7-4377-b431-95e5aedd1315 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:11.296765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21396-a8c7-4377-b431-95e5aedd1315 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:11.296864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21396-a8c7-4377-b431-95e5aedd1315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:11.304861 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:11.326211 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-60d21396-a8c7-4377-b431-95e5aedd1315 None None] MFA Rules not processed for user `ca11ea548a94415cadb14f3e5266198b`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:11.327434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-60d21396-a8c7-4377-b431-95e5aedd1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:11.398854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1210/2436] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:11.411392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:11.413403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:11.472127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5b739-caf6-4b0e-bbed-ae233d4bebb0 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:11.476460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93e439-370e-4a96-a714-6b758d4fc1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:11.477066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93e439-370e-4a96-a714-6b758d4fc1ae service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:11.477346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93e439-370e-4a96-a714-6b758d4fc1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:11.477637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93e439-370e-4a96-a714-6b758d4fc1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:11.486102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93e439-370e-4a96-a714-6b758d4fc1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:11.487575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93e439-370e-4a96-a714-6b758d4fc1ae service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:11.496515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1227/2437] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:12.533690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d21396-a8c7-4377-b431-95e5aedd1315 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:12.535763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-60d21396-a8c7-4377-b431-95e5aedd1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:12.611815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d21396-a8c7-4377-b431-95e5aedd1315 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:12.617544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:12.618120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:12.618856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:12.618856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:12.620629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:12.682655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:12.695593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:12.695593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1211/2438] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:13.216187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7803-1400-40ee-be86-7dfc6e365835 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:13.216660 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7803-1400-40ee-be86-7dfc6e365835 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:13.216758 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7803-1400-40ee-be86-7dfc6e365835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:13.235628 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-6bbe7803-1400-40ee-be86-7dfc6e365835 None None] MFA Rules not processed for user `ca11ea548a94415cadb14f3e5266198b`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:13.236856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6bbe7803-1400-40ee-be86-7dfc6e365835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:13.244473 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1228/2439] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:13.480062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:13.489494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d01b4-b348-46c6-9d18-feaf3e635bc9 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:13.493111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:13.493790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:13.498656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:13.498656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:13.498656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:13.505395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:13.506858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:13.514907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1212/2440] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:13.911151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7803-1400-40ee-be86-7dfc6e365835 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:13.912761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6bbe7803-1400-40ee-be86-7dfc6e365835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:13.976959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:13.982902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7803-1400-40ee-be86-7dfc6e365835 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:13.987845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:13.988949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:13.989251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:13.989522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:13.991284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:14.002307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:14.004515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:14.014786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1229/2441] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:40:17.983625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:17.985065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:17.996270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a975bba-3e7f-4853-86df-97c0cdbf1603 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:17.999931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:18.000700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:18.004510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:18.004510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:18.004510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:18.012892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:18.014624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:18.022623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1213/2442] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:18.786267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:18.787723 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:18.807810 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc6625-8b8a-4ec2-83a5-5a11b5d7a3bb service placement] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:18.820139 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5482-7c7e-4e0a-95a5-f29d447839f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:18.820790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5482-7c7e-4e0a-95a5-f29d447839f9 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:18.821079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5482-7c7e-4e0a-95a5-f29d447839f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:18.821355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5482-7c7e-4e0a-95a5-f29d447839f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:18.823167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-33dd5482-7c7e-4e0a-95a5-f29d447839f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:18.835751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5482-7c7e-4e0a-95a5-f29d447839f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:18.837331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5482-7c7e-4e0a-95a5-f29d447839f9 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:18.848315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1230/2443] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:25.193343 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:25.200402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:25.207342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492428-e0a7-4fb2-b501-35e210009c1b service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:25.213207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:25.213862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:25.214148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:25.214426 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:25.216189 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:25.228488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:25.230107 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:25.241470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1214/2444] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:26.839320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a29998-69dd-4355-9fd7-8f051f2a5a13 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:26.839849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a29998-69dd-4355-9fd7-8f051f2a5a13 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:26.839959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a29998-69dd-4355-9fd7-8f051f2a5a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:26.859420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-09a29998-69dd-4355-9fd7-8f051f2a5a13 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:26.860635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-09a29998-69dd-4355-9fd7-8f051f2a5a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:26.930270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1231/2445] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:26.977498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:26.979170 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:27.088999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b9baa-968f-49dd-b7f2-5b0ef1d59bac service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:27.094715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ec3ba-5de4-48c1-be40-4e8cb5bd1ced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:27.095362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ec3ba-5de4-48c1-be40-4e8cb5bd1ced service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:27.095651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ec3ba-5de4-48c1-be40-4e8cb5bd1ced service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:27.095922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ec3ba-5de4-48c1-be40-4e8cb5bd1ced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:27.107233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ec3ba-5de4-48c1-be40-4e8cb5bd1ced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:27.109228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ec3ba-5de4-48c1-be40-4e8cb5bd1ced service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:27.120827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1215/2446] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:40:32.338972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a29998-69dd-4355-9fd7-8f051f2a5a13 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:32.362856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a29998-69dd-4355-9fd7-8f051f2a5a13 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:32.399167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fdeb4-1679-49f4-a065-f82741ecf1e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:32.399167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fdeb4-1679-49f4-a065-f82741ecf1e2 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:32.399167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fdeb4-1679-49f4-a065-f82741ecf1e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:32.399167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fdeb4-1679-49f4-a065-f82741ecf1e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:32.402415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bf6fdeb4-1679-49f4-a065-f82741ecf1e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:32.442787 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fdeb4-1679-49f4-a065-f82741ecf1e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:32.447059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fdeb4-1679-49f4-a065-f82741ecf1e2 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:32.498735 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1232/2447] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:37.116663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=37 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:37.118971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5c50-817c-4d5c-91a1-83faca710e04 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:37.119509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5c50-817c-4d5c-91a1-83faca710e04 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:37.120501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5c50-817c-4d5c-91a1-83faca710e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:37.157548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-045c5c50-817c-4d5c-91a1-83faca710e04 None None] MFA Rules not processed for user `ca11ea548a94415cadb14f3e5266198b`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:37.159266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-045c5c50-817c-4d5c-91a1-83faca710e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:37.171637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1216/2448] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:37.921193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78be5c-4439-4d50-9d5c-29161ebf2751 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:37.921777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78be5c-4439-4d50-9d5c-29161ebf2751 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:37.921777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78be5c-4439-4d50-9d5c-29161ebf2751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:37.947143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8f78be5c-4439-4d50-9d5c-29161ebf2751 None None] MFA Rules not processed for user `21f47cbaa3084658a6b60da569419ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:37.948469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8f78be5c-4439-4d50-9d5c-29161ebf2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:38.054540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1233/2449] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:38.468154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c5c50-817c-4d5c-91a1-83faca710e04 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:38.496851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c5c50-817c-4d5c-91a1-83faca710e04 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:38.505754 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:38.506976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:38.507878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:38.508484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:38.510892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:38.526277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:38.529007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:38.559139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1217/2450] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:47.126645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5abe0-5d2f-41f6-8fcc-4e97639ae446 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:47.140179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5abe0-5d2f-41f6-8fcc-4e97639ae446 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:47.140179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5abe0-5d2f-41f6-8fcc-4e97639ae446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:47.140179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=68 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:47.155200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f7f5abe0-5d2f-41f6-8fcc-4e97639ae446 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:47.156424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f7f5abe0-5d2f-41f6-8fcc-4e97639ae446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:47.164218 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1234/2451] 10.222.0.61 () {58 vars in 967 bytes} [Tue Aug 23 16:40:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:47.177928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:47.190772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ee69e-321a-415e-bab4-b80248277732 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:47.197415 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8ea6e-1d03-4535-9ee1-10f1f9eaaf08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:47.198646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8ea6e-1d03-4535-9ee1-10f1f9eaaf08 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:47.198646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8ea6e-1d03-4535-9ee1-10f1f9eaaf08 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:47.200748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8ea6e-1d03-4535-9ee1-10f1f9eaaf08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:47.210488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8ea6e-1d03-4535-9ee1-10f1f9eaaf08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:47.212511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8ea6e-1d03-4535-9ee1-10f1f9eaaf08 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:47.224226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1218/2452] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:40:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:40:47.794915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5abe0-5d2f-41f6-8fcc-4e97639ae446 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:47.807876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5abe0-5d2f-41f6-8fcc-4e97639ae446 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:47.813369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992ff92-1743-4917-93a4-8300bbcd80c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:47.814623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ff92-1743-4917-93a4-8300bbcd80c1 service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:47.814902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ff92-1743-4917-93a4-8300bbcd80c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:47.815172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992ff92-1743-4917-93a4-8300bbcd80c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:47.816895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8992ff92-1743-4917-93a4-8300bbcd80c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:47.827430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ff92-1743-4917-93a4-8300bbcd80c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:47.829031 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992ff92-1743-4917-93a4-8300bbcd80c1 service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:47.837810 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1235/2453] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:49.835923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8ea6e-1d03-4535-9ee1-10f1f9eaaf08 service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:49.846777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8ea6e-1d03-4535-9ee1-10f1f9eaaf08 service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:49.850591 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:49.851194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:49.851812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:49.852889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:49.856419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:49.870409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:49.871852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:49.884091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1219/2454] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:40:54.489010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65fbf3-9835-4f4f-bf24-a86670fa81be None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:54.490113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65fbf3-9835-4f4f-bf24-a86670fa81be None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:54.490546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65fbf3-9835-4f4f-bf24-a86670fa81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:54.511574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4a65fbf3-9835-4f4f-bf24-a86670fa81be None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:54.513322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4a65fbf3-9835-4f4f-bf24-a86670fa81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:54.528214 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1236/2455] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:54.538963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:54.553143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2e821-89f6-4da7-bd94-9915ccd66473 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:54.578209 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d27b08-d1c7-495f-9b85-c8b5e7dcec37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:54.580366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d27b08-d1c7-495f-9b85-c8b5e7dcec37 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:54.581701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d27b08-d1c7-495f-9b85-c8b5e7dcec37 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:54.582195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d27b08-d1c7-495f-9b85-c8b5e7dcec37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:54.598494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d27b08-d1c7-495f-9b85-c8b5e7dcec37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:54.602435 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d27b08-d1c7-495f-9b85-c8b5e7dcec37 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:54.615633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1220/2456] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:40:56.918822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65fbf3-9835-4f4f-bf24-a86670fa81be None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:56.920392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4a65fbf3-9835-4f4f-bf24-a86670fa81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:56.947190 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65fbf3-9835-4f4f-bf24-a86670fa81be None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:56.963202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:56.963750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:56.964037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:56.964299 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] PATH_INFO: `/v3/users/f2d6e1a8b75547468e2294bff8274c33` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:56.965515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d6e1a8b75547468e2294bff8274c33)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:56.967538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:57.262468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d6e1a8b75547468e2294bff8274c33'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:57.263725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d6e1a8b75547468e2294bff8274c33'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:57.264076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d6e1a8b75547468e2294bff8274c33'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:57.390202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d6e1a8b75547468e2294bff8274c33'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:57.415936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1bbf06f4-ee1b-4b2b-b1e3-9af9de117e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d6e1a8b75547468e2294bff8274c33'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:57.447952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1237/2457] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:40:56 2022] DELETE /identity/v3/users/f2d6e1a8b75547468e2294bff8274c33 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:58.352376 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d27b08-d1c7-495f-9b85-c8b5e7dcec37 service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:58.370395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d27b08-d1c7-495f-9b85-c8b5e7dcec37 service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:58.560465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:58.561264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:58.561549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:58.563796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] PATH_INFO: `/v3/projects/3ce9190db34f4b40a81e9605cb05ae97` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:58.566529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce9190db34f4b40a81e9605cb05ae97)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:58.567017 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:58.767248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce9190db34f4b40a81e9605cb05ae97', 'request_id': 'req-eb0cb454-b175-4551-a086-ccf6c69c4a42'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:58.885778 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce9190db34f4b40a81e9605cb05ae97', 'request_id': 'req-eb0cb454-b175-4551-a086-ccf6c69c4a42'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:58.900849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce9190db34f4b40a81e9605cb05ae97', 'request_id': 'req-eb0cb454-b175-4551-a086-ccf6c69c4a42'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:58.948414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] The token cache is being invalidate because project 3ce9190db34f4b40a81e9605cb05ae97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:40:58.948727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:58.949819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eb0cb454-b175-4551-a086-ccf6c69c4a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:40:58.954637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1221/2458] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:40:58 2022] DELETE /identity/v3/projects/3ce9190db34f4b40a81e9605cb05ae97 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:40:58.963862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9921-876f-4efd-8943-ffd304f5ecec None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:58.965425 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9921-876f-4efd-8943-ffd304f5ecec None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:58.973868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e9921-876f-4efd-8943-ffd304f5ecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:59.023356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1e4e9921-876f-4efd-8943-ffd304f5ecec None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:59.037833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1e4e9921-876f-4efd-8943-ffd304f5ecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:59.209852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1238/2459] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:59.209982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2790369-483a-44b9-933a-e235b8eb23f6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:59.209982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2790369-483a-44b9-933a-e235b8eb23f6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:59.209982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2790369-483a-44b9-933a-e235b8eb23f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:59.252916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-f2790369-483a-44b9-933a-e235b8eb23f6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:40:59.257319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f2790369-483a-44b9-933a-e235b8eb23f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:40:59.285937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1222/2460] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:40:59.289042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e9921-876f-4efd-8943-ffd304f5ecec None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:59.310687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e9921-876f-4efd-8943-ffd304f5ecec None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:59.339114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:59.340007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:59.346000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:59.346519 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:59.347406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:40:59.348046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:59.349931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:59.390922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1239/2461] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:40:59.395955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2790369-483a-44b9-933a-e235b8eb23f6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:59.416410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2790369-483a-44b9-933a-e235b8eb23f6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:59.426032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533afd6a-36dd-45e2-b27e-18a77c29b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:59.427097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533afd6a-36dd-45e2-b27e-18a77c29b8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:59.427604 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533afd6a-36dd-45e2-b27e-18a77c29b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:59.428109 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533afd6a-36dd-45e2-b27e-18a77c29b8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:59.428992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533afd6a-36dd-45e2-b27e-18a77c29b8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:59.431529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533afd6a-36dd-45e2-b27e-18a77c29b8bc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:59.571293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1223/2462] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:40:59 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:40:59.576244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:59.590188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e73f4-950c-456c-bb24-12f06044a56d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:59.649316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:59.712466 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fc7cc-2f17-4279-883b-e27534e96d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:59.713107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fc7cc-2f17-4279-883b-e27534e96d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:59.714158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fc7cc-2f17-4279-883b-e27534e96d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:59.714158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fc7cc-2f17-4279-883b-e27534e96d14 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:59.720082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fc7cc-2f17-4279-883b-e27534e96d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:59.722247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fc7cc-2f17-4279-883b-e27534e96d14 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:59.910858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1240/2463] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:40:59 2022] POST /identity/v3/users => generated 303 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:40:59.914935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533afd6a-36dd-45e2-b27e-18a77c29b8bc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:59.920388 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:59.931896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533afd6a-36dd-45e2-b27e-18a77c29b8bc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:40:59.961226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943ddae-9e2b-4901-a172-038ec87c3670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:40:59.961226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943ddae-9e2b-4901-a172-038ec87c3670 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:40:59.961226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943ddae-9e2b-4901-a172-038ec87c3670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:40:59.961226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943ddae-9e2b-4901-a172-038ec87c3670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:40:59.962518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943ddae-9e2b-4901-a172-038ec87c3670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:40:59.962518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943ddae-9e2b-4901-a172-038ec87c3670 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:40:59.977668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1224/2464] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:40:59.981450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fc7cc-2f17-4279-883b-e27534e96d14 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:40:59.992672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fc7cc-2f17-4279-883b-e27534e96d14 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:00.007768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ed8fe-599c-4929-b843-2c8bd562a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:00.008410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ed8fe-599c-4929-b843-2c8bd562a5bb admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:00.008692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ed8fe-599c-4929-b843-2c8bd562a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:00.008969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ed8fe-599c-4929-b843-2c8bd562a5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:00.012302 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ed8fe-599c-4929-b843-2c8bd562a5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:00.015018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ed8fe-599c-4929-b843-2c8bd562a5bb admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:00.045696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1241/2465] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:00.050641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943ddae-9e2b-4901-a172-038ec87c3670 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:00.077843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943ddae-9e2b-4901-a172-038ec87c3670 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:00.086686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:00.087366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:00.087650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:00.087963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] PATH_INFO: `/v3/projects/27a0ab31159645de999b94b42fc86cbe/users/932ce7adc41443f69ffc0533afb34aec/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:00.104318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a0ab31159645de999b94b42fc86cbe, user_id=932ce7adc41443f69ffc0533afb34aec, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:00.107054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:00.209834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1225/2466] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:00 2022] PUT /identity/v3/projects/27a0ab31159645de999b94b42fc86cbe/users/932ce7adc41443f69ffc0533afb34aec/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:00.214896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda0cf5-d785-431f-b19d-7afc1725178f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:00.215460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda0cf5-d785-431f-b19d-7afc1725178f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:00.215808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda0cf5-d785-431f-b19d-7afc1725178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:00.240319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-2cda0cf5-d785-431f-b19d-7afc1725178f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:00.241599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2cda0cf5-d785-431f-b19d-7afc1725178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:00.315111 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1242/2467] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:00.322508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:00.325974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:00.406200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82bde0-b164-45dc-b72b-76f121b379d8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:00.416458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:00.417179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:00.417485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:00.417913 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:00.428691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:00.431106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:00.443943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1226/2468] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:01.323210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda0cf5-d785-431f-b19d-7afc1725178f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:01.325598 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2cda0cf5-d785-431f-b19d-7afc1725178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:01.489261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda0cf5-d785-431f-b19d-7afc1725178f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:01.497588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:01.498671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:01.499052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:01.499350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:01.501517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:01.515320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:01.517762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:01.556482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1243/2469] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:01.561395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:01.563732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:01.582834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969b88d-c942-4c39-8028-292849ee5574 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:01.587943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:01.588565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:01.588850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:01.589378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] PATH_INFO: `/v3/users/00fe878ae7f047f9a7d5f939b5cb0ab1` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:01.590763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00fe878ae7f047f9a7d5f939b5cb0ab1)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:01.592700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:01.845736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00fe878ae7f047f9a7d5f939b5cb0ab1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:01.868869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00fe878ae7f047f9a7d5f939b5cb0ab1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:01.870355 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00fe878ae7f047f9a7d5f939b5cb0ab1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:01.871541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00fe878ae7f047f9a7d5f939b5cb0ab1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:01.908613 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-fdf8fcb0-b47e-4b5b-82f0-65fcf9739645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00fe878ae7f047f9a7d5f939b5cb0ab1'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:01.996201 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1227/2470] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:01 2022] DELETE /identity/v3/users/00fe878ae7f047f9a7d5f939b5cb0ab1 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:02.419113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:02.438516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8002-8172-4d45-ab82-bef891a1a149 service placement] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:02.499856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaf5ab-4cc1-4ce4-95f8-e25271806d03 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:02.500204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaf5ab-4cc1-4ce4-95f8-e25271806d03 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:02.500469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaf5ab-4cc1-4ce4-95f8-e25271806d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:02.518197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:02.543438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ddaaf5ab-4cc1-4ce4-95f8-e25271806d03 None None] MFA Rules not processed for user `932ce7adc41443f69ffc0533afb34aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:02.545005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ddaaf5ab-4cc1-4ce4-95f8-e25271806d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:02.570547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:02.572034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:02.572458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:02.573097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] PATH_INFO: `/v3/projects/9cebad2d8201484f948d1ac6062ebae1` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:02.576915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cebad2d8201484f948d1ac6062ebae1)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:02.584315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:02.590882 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:02.639228 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1228/2471] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:02.643814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaf5ab-4cc1-4ce4-95f8-e25271806d03 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:02.646222 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ddaaf5ab-4cc1-4ce4-95f8-e25271806d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:02.668624 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaf5ab-4cc1-4ce4-95f8-e25271806d03 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:02.674464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b97a-f113-41a2-9e9c-d53eb7cdbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:02.675119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b97a-f113-41a2-9e9c-d53eb7cdbde3 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:02.675405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b97a-f113-41a2-9e9c-d53eb7cdbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:02.675669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5b97a-f113-41a2-9e9c-d53eb7cdbde3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:02.676297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5b97a-f113-41a2-9e9c-d53eb7cdbde3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:02.678290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5b97a-f113-41a2-9e9c-d53eb7cdbde3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:02.723539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cebad2d8201484f948d1ac6062ebae1', 'request_id': 'req-2ead15f2-617f-441a-a45e-e28b47951c46'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:02.731339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cebad2d8201484f948d1ac6062ebae1', 'request_id': 'req-2ead15f2-617f-441a-a45e-e28b47951c46'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:02.825655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1229/2472] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:02 2022] POST /identity/v3/projects => generated 403 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:02.827974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b97a-f113-41a2-9e9c-d53eb7cdbde3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:02.829198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cebad2d8201484f948d1ac6062ebae1', 'request_id': 'req-2ead15f2-617f-441a-a45e-e28b47951c46'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:02.853826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] The token cache is being invalidate because project 9cebad2d8201484f948d1ac6062ebae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:02.854278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:02.858032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:02.865112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1244/2473] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:02 2022] DELETE /identity/v3/projects/9cebad2d8201484f948d1ac6062ebae1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:02.866268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:02.868950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:02.945576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5b97a-f113-41a2-9e9c-d53eb7cdbde3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:02.952455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:02.954472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:02.954964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:02.955246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:02.956135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:02.958410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:02.967402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead15f2-617f-441a-a45e-e28b47951c46 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:02.973770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:02.974569 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:02.975023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:02.975399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] PATH_INFO: `/v3/users/4ace722241bc4967af63cceb614e6ae6` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:02.976690 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ace722241bc4967af63cceb614e6ae6)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:02.979000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:03.083503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1230/2474] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:02 2022] POST /identity/v3/users => generated 308 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:03.088513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:03.097461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:03.118880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565c32a-2ef0-434b-aac6-dbbc67b8b95e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:03.124056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8f0c5-cf26-4fd1-9c3a-dd8e9c7c15b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:03.124638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8f0c5-cf26-4fd1-9c3a-dd8e9c7c15b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:03.124924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8f0c5-cf26-4fd1-9c3a-dd8e9c7c15b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:03.125815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8f0c5-cf26-4fd1-9c3a-dd8e9c7c15b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:03.126474 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8f0c5-cf26-4fd1-9c3a-dd8e9c7c15b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:03.128144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8f0c5-cf26-4fd1-9c3a-dd8e9c7c15b6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:03.156553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1231/2475] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:03.160835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8f0c5-cf26-4fd1-9c3a-dd8e9c7c15b6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:03.175384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8f0c5-cf26-4fd1-9c3a-dd8e9c7c15b6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:03.180503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:03.183248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:03.183248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:03.183248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] PATH_INFO: `/v3/projects/9792818f83784218b9021515fdcb6038/users/40b1766ab06544e0955e848b3d30c760/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:03.213369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9792818f83784218b9021515fdcb6038, user_id=40b1766ab06544e0955e848b3d30c760, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:03.217241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:03.226739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ace722241bc4967af63cceb614e6ae6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:03.227892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ace722241bc4967af63cceb614e6ae6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:03.228568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ace722241bc4967af63cceb614e6ae6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:03.333119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ace722241bc4967af63cceb614e6ae6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:03.341870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1232/2476] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:03 2022] PUT /identity/v3/projects/9792818f83784218b9021515fdcb6038/users/40b1766ab06544e0955e848b3d30c760/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:03.346490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:03.348483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:03.357176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ace722241bc4967af63cceb614e6ae6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:03.368468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:03.382375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1245/2477] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:02 2022] DELETE /identity/v3/users/4ace722241bc4967af63cceb614e6ae6 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:03.433935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295904b-b379-4cda-934f-9864d795d2d9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:03.444050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:03.501991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:03.502691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:03.502979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:03.504206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:03.504206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:03.507214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:03.518607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1233/2478] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:03.522582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:03.536577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14f499-a43f-4417-9e43-7b6d008e86a0 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:03.542364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67d023-7554-4672-9f80-c5c6189efb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:03.543272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67d023-7554-4672-9f80-c5c6189efb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:03.543708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67d023-7554-4672-9f80-c5c6189efb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:03.544198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67d023-7554-4672-9f80-c5c6189efb95 admin admin] PATH_INFO: `/v3/projects/9792818f83784218b9021515fdcb6038/users/40b1766ab06544e0955e848b3d30c760/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:03.546345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67d023-7554-4672-9f80-c5c6189efb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9792818f83784218b9021515fdcb6038, user_id=40b1766ab06544e0955e848b3d30c760, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:03.549972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67d023-7554-4672-9f80-c5c6189efb95 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:03.570192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1246/2479] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:03 2022] PUT /identity/v3/projects/9792818f83784218b9021515fdcb6038/users/40b1766ab06544e0955e848b3d30c760/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:03.770550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:03.775032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:03.796411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d2a44-c5bd-42f5-9022-1e0ec471c830 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:03.898582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:03.899689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:03.899839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:03.900200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] PATH_INFO: `/v3/projects/cb1e442637684113b258785c0c0c4f84` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:03.901559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1e442637684113b258785c0c0c4f84)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:03.904292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:04.216310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1e442637684113b258785c0c0c4f84', 'request_id': 'req-377f7bdf-acca-419f-8e9d-4367a06ed72d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:04.652982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1e442637684113b258785c0c0c4f84', 'request_id': 'req-377f7bdf-acca-419f-8e9d-4367a06ed72d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:04.663687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1e442637684113b258785c0c0c4f84', 'request_id': 'req-377f7bdf-acca-419f-8e9d-4367a06ed72d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:04.687165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] The token cache is being invalidate because project cb1e442637684113b258785c0c0c4f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:04.687996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:04.689603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:04.697070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1234/2480] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:03 2022] DELETE /identity/v3/projects/cb1e442637684113b258785c0c0c4f84 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:06.778947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb5887-65ee-4282-b687-59edc1fea34a None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:06.782208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb5887-65ee-4282-b687-59edc1fea34a None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:06.782208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb5887-65ee-4282-b687-59edc1fea34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:06.808619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-aedb5887-65ee-4282-b687-59edc1fea34a None None] MFA Rules not processed for user `40b1766ab06544e0955e848b3d30c760`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:06.812106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-aedb5887-65ee-4282-b687-59edc1fea34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:06.880835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1247/2481] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:06 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:08.270122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:08.271613 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:08.314319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:08.335595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f7bdf-acca-419f-8e9d-4367a06ed72d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:08.340167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:08.340795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:08.341077 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:08.341348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] PATH_INFO: `/v3/users/932ce7adc41443f69ffc0533afb34aec` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:08.342495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932ce7adc41443f69ffc0533afb34aec)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:08.344911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:08.585714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932ce7adc41443f69ffc0533afb34aec'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:08.592574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932ce7adc41443f69ffc0533afb34aec'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:08.593244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932ce7adc41443f69ffc0533afb34aec'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:08.594393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932ce7adc41443f69ffc0533afb34aec'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:08.606738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932ce7adc41443f69ffc0533afb34aec'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:08.707869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1235/2482] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:08 2022] DELETE /identity/v3/users/932ce7adc41443f69ffc0533afb34aec => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:08.968200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb5887-65ee-4282-b687-59edc1fea34a None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:08.981856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb5887-65ee-4282-b687-59edc1fea34a None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:09.059604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:09.061043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:09.061043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:09.061246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] PATH_INFO: `/v3/projects/27a0ab31159645de999b94b42fc86cbe` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:09.062883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a0ab31159645de999b94b42fc86cbe)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:09.064790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:09.267408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a0ab31159645de999b94b42fc86cbe', 'request_id': 'req-f2aa1092-7990-49b4-80e3-0cf573d17a0f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.274112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a0ab31159645de999b94b42fc86cbe', 'request_id': 'req-f2aa1092-7990-49b4-80e3-0cf573d17a0f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.349095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a0ab31159645de999b94b42fc86cbe', 'request_id': 'req-f2aa1092-7990-49b4-80e3-0cf573d17a0f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.358394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:09.365202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] The token cache is being invalidate because project 27a0ab31159645de999b94b42fc86cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:09.365498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.366184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.367658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1248/2483] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:08 2022] DELETE /identity/v3/projects/27a0ab31159645de999b94b42fc86cbe => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:09.371766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:09.373447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:09.390420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2736c5-d74c-4c4f-a17b-f4f6ba0486c2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:09.462541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:09.468305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:09.468305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:09.468305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] PATH_INFO: `/v3/users/40b1766ab06544e0955e848b3d30c760` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:09.468305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b1766ab06544e0955e848b3d30c760)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:09.468305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:09.636098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b1766ab06544e0955e848b3d30c760'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.643922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b1766ab06544e0955e848b3d30c760'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.644596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b1766ab06544e0955e848b3d30c760'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.645272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b1766ab06544e0955e848b3d30c760'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.647247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:09.658821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eb80258-eb79-4935-a291-4de83e756c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b1766ab06544e0955e848b3d30c760'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:09.755280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1236/2484] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:09 2022] DELETE /identity/v3/users/40b1766ab06544e0955e848b3d30c760 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:10.008179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:10.009744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:10.032958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa1092-7990-49b4-80e3-0cf573d17a0f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:10.100439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:10.101113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.101397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.101703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] PATH_INFO: `/v3/projects/9792818f83784218b9021515fdcb6038` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.102810 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9792818f83784218b9021515fdcb6038)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:10.104720 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:10.246233 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9792818f83784218b9021515fdcb6038', 'request_id': 'req-fad220c0-ec82-4678-a31e-2ab4a07b6725'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:10.253270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9792818f83784218b9021515fdcb6038', 'request_id': 'req-fad220c0-ec82-4678-a31e-2ab4a07b6725'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:10.335880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9792818f83784218b9021515fdcb6038', 'request_id': 'req-fad220c0-ec82-4678-a31e-2ab4a07b6725'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:10.346901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] The token cache is being invalidate because project 9792818f83784218b9021515fdcb6038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:10.350734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:10.350734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-fad220c0-ec82-4678-a31e-2ab4a07b6725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:10.350734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1249/2485] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:10 2022] DELETE /identity/v3/projects/9792818f83784218b9021515fdcb6038 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:10.354279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98942edf-9b64-412b-b9a3-99172a96850e None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.354568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98942edf-9b64-412b-b9a3-99172a96850e None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.354846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98942edf-9b64-412b-b9a3-99172a96850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.374633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-98942edf-9b64-412b-b9a3-99172a96850e None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:10.376511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-98942edf-9b64-412b-b9a3-99172a96850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:10.434475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1237/2486] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:10.442450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa517-40ea-4920-974b-b9466a9afc07 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.442743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa517-40ea-4920-974b-b9466a9afc07 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.443025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa517-40ea-4920-974b-b9466a9afc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.462992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b66aa517-40ea-4920-974b-b9466a9afc07 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:10.464201 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b66aa517-40ea-4920-974b-b9466a9afc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:10.481749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1250/2487] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:10.484844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98942edf-9b64-412b-b9a3-99172a96850e None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:10.494502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98942edf-9b64-412b-b9a3-99172a96850e None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:10.499035 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:10.499633 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.499915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.501139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.501836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:41:10.502143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:10.503786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:10.515934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1238/2488] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:41:10.520188 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aa517-40ea-4920-974b-b9466a9afc07 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:10.529660 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aa517-40ea-4920-974b-b9466a9afc07 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:10.535061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aed22c-5ebb-4448-a694-ddc1d08c693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:10.535682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aed22c-5ebb-4448-a694-ddc1d08c693b admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.535962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aed22c-5ebb-4448-a694-ddc1d08c693b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.536234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aed22c-5ebb-4448-a694-ddc1d08c693b admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.536878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aed22c-5ebb-4448-a694-ddc1d08c693b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:10.538901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aed22c-5ebb-4448-a694-ddc1d08c693b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:10.635850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1251/2489] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:10 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:10.639922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:10.650242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8d08b-c495-4e5c-9b8c-13b5577c0d5f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:10.705471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133e833-956f-40cb-9381-a2eda9fac873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:10.706094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133e833-956f-40cb-9381-a2eda9fac873 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.706372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133e833-956f-40cb-9381-a2eda9fac873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.706640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133e833-956f-40cb-9381-a2eda9fac873 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.707263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133e833-956f-40cb-9381-a2eda9fac873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:10.709160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133e833-956f-40cb-9381-a2eda9fac873 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:10.834417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1239/2490] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:10 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:10.835874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aed22c-5ebb-4448-a694-ddc1d08c693b admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:10.846082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aed22c-5ebb-4448-a694-ddc1d08c693b admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:10.850680 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c1408-84b1-4125-ad7d-d87a9b394167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:10.851285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c1408-84b1-4125-ad7d-d87a9b394167 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.851567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c1408-84b1-4125-ad7d-d87a9b394167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.851842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c1408-84b1-4125-ad7d-d87a9b394167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.852515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c1408-84b1-4125-ad7d-d87a9b394167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:10.854153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c1408-84b1-4125-ad7d-d87a9b394167 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:10.864745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1252/2491] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:10.868978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133e833-956f-40cb-9381-a2eda9fac873 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:10.880006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133e833-956f-40cb-9381-a2eda9fac873 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:10.884831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80118825-ad08-46d1-8268-a73f1418ecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:10.885423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80118825-ad08-46d1-8268-a73f1418ecde admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.888607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80118825-ad08-46d1-8268-a73f1418ecde admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.888607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80118825-ad08-46d1-8268-a73f1418ecde admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.888607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80118825-ad08-46d1-8268-a73f1418ecde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:10.888607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80118825-ad08-46d1-8268-a73f1418ecde admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:10.899718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1240/2492] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:10.904337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c1408-84b1-4125-ad7d-d87a9b394167 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:10.915224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c1408-84b1-4125-ad7d-d87a9b394167 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:10.919848 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b35ab3-1fd7-4361-a4bb-2f1281ed6878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:10.920495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35ab3-1fd7-4361-a4bb-2f1281ed6878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.920781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35ab3-1fd7-4361-a4bb-2f1281ed6878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.921059 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b35ab3-1fd7-4361-a4bb-2f1281ed6878 admin admin] PATH_INFO: `/v3/projects/c4e4bef9051c4cf5857b23cb95d711cc/users/c22021b982494298a22518645063db9a/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.935472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b35ab3-1fd7-4361-a4bb-2f1281ed6878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e4bef9051c4cf5857b23cb95d711cc, user_id=c22021b982494298a22518645063db9a, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:10.938661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b35ab3-1fd7-4361-a4bb-2f1281ed6878 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:10.971208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610caef-3055-43cc-b4b0-0a485da4c761 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:10.971498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610caef-3055-43cc-b4b0-0a485da4c761 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:10.971772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610caef-3055-43cc-b4b0-0a485da4c761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:10.991278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b610caef-3055-43cc-b4b0-0a485da4c761 None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:10.993301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b610caef-3055-43cc-b4b0-0a485da4c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:11.017874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1253/2493] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:10 2022] PUT /identity/v3/projects/c4e4bef9051c4cf5857b23cb95d711cc/users/c22021b982494298a22518645063db9a/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:11.029790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c56f-b9d6-42e1-8012-1ea1dbb008f8 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.029967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c56f-b9d6-42e1-8012-1ea1dbb008f8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.030148 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67c56f-b9d6-42e1-8012-1ea1dbb008f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:11.035330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:11.054618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1241/2494] 10.222.0.61 () {58 vars in 1009 bytes} [Tue Aug 23 16:41:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:11.061703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8c67c56f-b9d6-42e1-8012-1ea1dbb008f8 None None] MFA Rules not processed for user `c22021b982494298a22518645063db9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:11.063795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8c67c56f-b9d6-42e1-8012-1ea1dbb008f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:11.069155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610caef-3055-43cc-b4b0-0a485da4c761 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:11.070774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b610caef-3055-43cc-b4b0-0a485da4c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:11.074376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:11.134981 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1254/2495] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:11.140338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c56f-b9d6-42e1-8012-1ea1dbb008f8 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:11.143600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610caef-3055-43cc-b4b0-0a485da4c761 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:11.202890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963914b-2d13-4fc3-a0ce-31a82ea56eb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:11.203508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963914b-2d13-4fc3-a0ce-31a82ea56eb0 service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.203787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963914b-2d13-4fc3-a0ce-31a82ea56eb0 service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.204061 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963914b-2d13-4fc3-a0ce-31a82ea56eb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:11.204999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67c56f-b9d6-42e1-8012-1ea1dbb008f8 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:11.209528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309220-5f8c-4330-aa97-e09ffadc9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:11.210164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309220-5f8c-4330-aa97-e09ffadc9cac admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.210750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309220-5f8c-4330-aa97-e09ffadc9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.210750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53309220-5f8c-4330-aa97-e09ffadc9cac admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:11.211346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309220-5f8c-4330-aa97-e09ffadc9cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:11.213242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53309220-5f8c-4330-aa97-e09ffadc9cac admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:11.264582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963914b-2d13-4fc3-a0ce-31a82ea56eb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:11.266378 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963914b-2d13-4fc3-a0ce-31a82ea56eb0 service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:11.274558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1242/2496] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:41:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:41:11.340755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1255/2497] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:11 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:11.341827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963914b-2d13-4fc3-a0ce-31a82ea56eb0 service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:11.353677 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963914b-2d13-4fc3-a0ce-31a82ea56eb0 service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:11.392460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:11.429755 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae64534-2ee8-4ec7-8833-733eda94904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:11.430672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64534-2ee8-4ec7-8833-733eda94904f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.431106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64534-2ee8-4ec7-8833-733eda94904f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.431526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae64534-2ee8-4ec7-8833-733eda94904f admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:11.432329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae64534-2ee8-4ec7-8833-733eda94904f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:11.434922 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae64534-2ee8-4ec7-8833-733eda94904f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:11.573143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1243/2498] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:11 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:11.578235 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309220-5f8c-4330-aa97-e09ffadc9cac admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:11.591701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53309220-5f8c-4330-aa97-e09ffadc9cac admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:11.599680 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486baad3-7f2f-4816-9e25-a67e2b7e0aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:11.600524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486baad3-7f2f-4816-9e25-a67e2b7e0aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.601401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486baad3-7f2f-4816-9e25-a67e2b7e0aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.601714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486baad3-7f2f-4816-9e25-a67e2b7e0aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:11.602379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486baad3-7f2f-4816-9e25-a67e2b7e0aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:11.604024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486baad3-7f2f-4816-9e25-a67e2b7e0aa1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:11.623577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1256/2499] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:11.624862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae64534-2ee8-4ec7-8833-733eda94904f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:11.635579 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae64534-2ee8-4ec7-8833-733eda94904f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:11.657299 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502eb8-73a0-40dd-b840-6401732895d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:11.660369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502eb8-73a0-40dd-b840-6401732895d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.660369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502eb8-73a0-40dd-b840-6401732895d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.660369 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502eb8-73a0-40dd-b840-6401732895d8 admin admin] PATH_INFO: `/v3/projects/26b1e1ac01a44897afc49f2dc3a98dd9/users/2c4829d204f04fe494ce2a2309f0830e/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:11.676361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b502eb8-73a0-40dd-b840-6401732895d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b1e1ac01a44897afc49f2dc3a98dd9, user_id=2c4829d204f04fe494ce2a2309f0830e, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:11.679251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b502eb8-73a0-40dd-b840-6401732895d8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:11.764539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1244/2500] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:11 2022] PUT /identity/v3/projects/26b1e1ac01a44897afc49f2dc3a98dd9/users/2c4829d204f04fe494ce2a2309f0830e/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:11.766541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486baad3-7f2f-4816-9e25-a67e2b7e0aa1 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:11.778899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486baad3-7f2f-4816-9e25-a67e2b7e0aa1 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:11.868327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad679a-99d0-446f-895d-7a02883ed0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:11.869036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad679a-99d0-446f-895d-7a02883ed0fb admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.869421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad679a-99d0-446f-895d-7a02883ed0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.869840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad679a-99d0-446f-895d-7a02883ed0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:11.870746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad679a-99d0-446f-895d-7a02883ed0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:11.872734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad679a-99d0-446f-895d-7a02883ed0fb admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:11.885661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1257/2501] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:11.889382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502eb8-73a0-40dd-b840-6401732895d8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:11.913351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502eb8-73a0-40dd-b840-6401732895d8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:11.927866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:11.929194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.929675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.930163 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] PATH_INFO: `/v3/projects/26b1e1ac01a44897afc49f2dc3a98dd9/users/2c4829d204f04fe494ce2a2309f0830e/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:11.933693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b1e1ac01a44897afc49f2dc3a98dd9, user_id=2c4829d204f04fe494ce2a2309f0830e, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:11.937496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:11.968208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1245/2502] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:11 2022] PUT /identity/v3/projects/26b1e1ac01a44897afc49f2dc3a98dd9/users/2c4829d204f04fe494ce2a2309f0830e/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:11.979017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fe2a-e0a0-4296-bba3-8f3e9c8ff5af None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:11.981324 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fe2a-e0a0-4296-bba3-8f3e9c8ff5af None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:11.981851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28fe2a-e0a0-4296-bba3-8f3e9c8ff5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:12.026640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4c28fe2a-e0a0-4296-bba3-8f3e9c8ff5af None None] MFA Rules not processed for user `2c4829d204f04fe494ce2a2309f0830e`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:12.029342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4c28fe2a-e0a0-4296-bba3-8f3e9c8ff5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:12.040088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:12.124449 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1258/2503] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:12.137742 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:12.140015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:12.215737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5218-a03f-4c88-9bf5-3a68c75d3bd6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:12.220856 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73efede-d757-4f0c-9ce7-f2a115792dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:12.222375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73efede-d757-4f0c-9ce7-f2a115792dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:12.222744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73efede-d757-4f0c-9ce7-f2a115792dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:12.223333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73efede-d757-4f0c-9ce7-f2a115792dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:12.292780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73efede-d757-4f0c-9ce7-f2a115792dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:12.295011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73efede-d757-4f0c-9ce7-f2a115792dd6 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:12.307979 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1246/2504] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:13.431381 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc78334-9eec-47e8-895e-c6f9f691316b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:13.432315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc78334-9eec-47e8-895e-c6f9f691316b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:13.432744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc78334-9eec-47e8-895e-c6f9f691316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:13.474160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-3cc78334-9eec-47e8-895e-c6f9f691316b None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:13.475840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3cc78334-9eec-47e8-895e-c6f9f691316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:13.556061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1259/2505] 10.222.0.61 () {58 vars in 967 bytes} [Tue Aug 23 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:13.576138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73efede-d757-4f0c-9ce7-f2a115792dd6 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:13.626858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:13.655443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73efede-d757-4f0c-9ce7-f2a115792dd6 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:13.661236 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe850-4033-4956-8888-3ef4db47279b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:13.662070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe850-4033-4956-8888-3ef4db47279b service swift] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:13.662431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe850-4033-4956-8888-3ef4db47279b service swift] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:13.662771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe850-4033-4956-8888-3ef4db47279b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:13.671207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe850-4033-4956-8888-3ef4db47279b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:13.673560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe850-4033-4956-8888-3ef4db47279b service swift] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:13.682127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1247/2506] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:41:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:41:14.243089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc78334-9eec-47e8-895e-c6f9f691316b None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:14.244965 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3cc78334-9eec-47e8-895e-c6f9f691316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:14.269583 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc78334-9eec-47e8-895e-c6f9f691316b None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:14.270505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce81fb1-ed08-42c1-b675-35c9b1e36725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:14.271226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce81fb1-ed08-42c1-b675-35c9b1e36725 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:14.271696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce81fb1-ed08-42c1-b675-35c9b1e36725 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:14.272141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce81fb1-ed08-42c1-b675-35c9b1e36725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:14.283712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce81fb1-ed08-42c1-b675-35c9b1e36725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:14.285293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce81fb1-ed08-42c1-b675-35c9b1e36725 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:14.299548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1260/2507] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:18.981125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe850-4033-4956-8888-3ef4db47279b service swift] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:19.085541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe850-4033-4956-8888-3ef4db47279b service swift] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:19.092486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:19.093096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:19.093417 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:19.093923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] PATH_INFO: `/v3/users/c22021b982494298a22518645063db9a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:19.095485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22021b982494298a22518645063db9a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:19.098402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:19.279289 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22021b982494298a22518645063db9a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:19.286775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22021b982494298a22518645063db9a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:19.287508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22021b982494298a22518645063db9a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:19.288137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22021b982494298a22518645063db9a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:19.303095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22021b982494298a22518645063db9a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:19.415545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1248/2508] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:18 2022] DELETE /identity/v3/users/c22021b982494298a22518645063db9a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:19.420191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb86b05-33b4-41ea-ba45-f326563c23d5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:19.421411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb86b05-33b4-41ea-ba45-f326563c23d5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:19.422847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb86b05-33b4-41ea-ba45-f326563c23d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:19.446636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-9bb86b05-33b4-41ea-ba45-f326563c23d5 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:19.447961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9bb86b05-33b4-41ea-ba45-f326563c23d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:19.552203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1261/2509] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:19.564918 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:19.567264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:19.634937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:19.641144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8921c-54cd-44e0-8bf2-9b3ff5014ec9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:19.645059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d6f6-d39b-464c-9ec7-0c44e4de739e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:19.647927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d6f6-d39b-464c-9ec7-0c44e4de739e service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:19.647927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d6f6-d39b-464c-9ec7-0c44e4de739e service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:19.647927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315d6f6-d39b-464c-9ec7-0c44e4de739e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:19.658167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d6f6-d39b-464c-9ec7-0c44e4de739e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:19.659842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315d6f6-d39b-464c-9ec7-0c44e4de739e service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:19.670849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1249/2510] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:20.181028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb86b05-33b4-41ea-ba45-f326563c23d5 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:20.181028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9bb86b05-33b4-41ea-ba45-f326563c23d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:20.183401 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb86b05-33b4-41ea-ba45-f326563c23d5 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:20.192278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:20.192607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:20.192980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:20.193307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] PATH_INFO: `/v3/projects/c4e4bef9051c4cf5857b23cb95d711cc` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:20.194872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e4bef9051c4cf5857b23cb95d711cc)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:20.196871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:20.332748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:20.343809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e4bef9051c4cf5857b23cb95d711cc', 'request_id': 'req-bb134cad-b260-4f1b-9470-4bf2fe7f9764'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:20.350421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e4bef9051c4cf5857b23cb95d711cc', 'request_id': 'req-bb134cad-b260-4f1b-9470-4bf2fe7f9764'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:20.731130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e4bef9051c4cf5857b23cb95d711cc', 'request_id': 'req-bb134cad-b260-4f1b-9470-4bf2fe7f9764'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:20.742550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] The token cache is being invalidate because project c4e4bef9051c4cf5857b23cb95d711cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:20.742844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:20.743470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:20.744945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1262/2511] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:20 2022] DELETE /identity/v3/projects/c4e4bef9051c4cf5857b23cb95d711cc => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:20.749040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d6f6-d39b-464c-9ec7-0c44e4de739e service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:20.762342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315d6f6-d39b-464c-9ec7-0c44e4de739e service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:20.847834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:20.848487 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:20.848758 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:20.849032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] PATH_INFO: `/v3/users/2c4829d204f04fe494ce2a2309f0830e` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:20.850197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4829d204f04fe494ce2a2309f0830e)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:20.852327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:21.080892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4829d204f04fe494ce2a2309f0830e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:21.091261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4829d204f04fe494ce2a2309f0830e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:21.092266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4829d204f04fe494ce2a2309f0830e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:21.092904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4829d204f04fe494ce2a2309f0830e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:21.110341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bdf4bc1a-2dc1-4021-9a00-e4496fcca945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4829d204f04fe494ce2a2309f0830e'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:21.218078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1250/2512] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:20 2022] DELETE /identity/v3/users/2c4829d204f04fe494ce2a2309f0830e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:21.693976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:21.695913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:21.719979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb134cad-b260-4f1b-9470-4bf2fe7f9764 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:21.801871 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:21.802854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:21.803286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:21.803565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] PATH_INFO: `/v3/projects/26b1e1ac01a44897afc49f2dc3a98dd9` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:21.805242 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b1e1ac01a44897afc49f2dc3a98dd9)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:21.807530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:21.929010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b1e1ac01a44897afc49f2dc3a98dd9', 'request_id': 'req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:21.936497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b1e1ac01a44897afc49f2dc3a98dd9', 'request_id': 'req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:22.011332 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b1e1ac01a44897afc49f2dc3a98dd9', 'request_id': 'req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:22.029719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] The token cache is being invalidate because project 26b1e1ac01a44897afc49f2dc3a98dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:22.029719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:22.029719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-f7178e3f-c64f-4ef8-b33d-0dc0f2ffe6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:22.033490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1263/2513] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:21 2022] DELETE /identity/v3/projects/26b1e1ac01a44897afc49f2dc3a98dd9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:22.038179 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f457c-5106-4875-b1a2-b829b62915cd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.039283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f457c-5106-4875-b1a2-b829b62915cd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.039833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f457c-5106-4875-b1a2-b829b62915cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.072402 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b48f457c-5106-4875-b1a2-b829b62915cd None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:22.073965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b48f457c-5106-4875-b1a2-b829b62915cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:22.147645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1251/2514] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:22.155430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697a6d-7cad-48ac-ae9c-0b1fe76cd9b0 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.155721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697a6d-7cad-48ac-ae9c-0b1fe76cd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.156534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697a6d-7cad-48ac-ae9c-0b1fe76cd9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.177083 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1f697a6d-7cad-48ac-ae9c-0b1fe76cd9b0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:22.178471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1f697a6d-7cad-48ac-ae9c-0b1fe76cd9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:22.186697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1264/2515] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:22.190992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f457c-5106-4875-b1a2-b829b62915cd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:22.200978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f457c-5106-4875-b1a2-b829b62915cd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:22.206746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:22.207472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.207839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.208231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.208953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:41:22.209377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:22.211294 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:22.214126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:22.226850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1252/2516] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:41:22.230898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f697a6d-7cad-48ac-ae9c-0b1fe76cd9b0 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:22.241151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f697a6d-7cad-48ac-ae9c-0b1fe76cd9b0 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:22.246872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380d32f-40e8-4b04-9077-387c0a28606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:22.247482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d32f-40e8-4b04-9077-387c0a28606e admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.247761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d32f-40e8-4b04-9077-387c0a28606e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.248034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d32f-40e8-4b04-9077-387c0a28606e admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.248674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380d32f-40e8-4b04-9077-387c0a28606e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:22.250698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380d32f-40e8-4b04-9077-387c0a28606e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:22.346135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1265/2517] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:22 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:22.349998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:22.360959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b652b3c-0e84-4a8d-bb09-d1c01cc9c23e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:22.426167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdacd-409c-4367-8387-8ef6acaa4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:22.426896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdacd-409c-4367-8387-8ef6acaa4412 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.427248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdacd-409c-4367-8387-8ef6acaa4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.427648 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdacd-409c-4367-8387-8ef6acaa4412 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.428292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cdacd-409c-4367-8387-8ef6acaa4412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:22.430658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cdacd-409c-4367-8387-8ef6acaa4412 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:22.495827 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1253/2518] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:22 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:22.497114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380d32f-40e8-4b04-9077-387c0a28606e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:22.507912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380d32f-40e8-4b04-9077-387c0a28606e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:22.513003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b0c9-6cbf-41b9-842f-f8f1b8bd84bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:22.513713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b0c9-6cbf-41b9-842f-f8f1b8bd84bf admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.515950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b0c9-6cbf-41b9-842f-f8f1b8bd84bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.515950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0b0c9-6cbf-41b9-842f-f8f1b8bd84bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.515950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0b0c9-6cbf-41b9-842f-f8f1b8bd84bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:22.517323 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0b0c9-6cbf-41b9-842f-f8f1b8bd84bf admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:22.531844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1266/2519] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:22.533178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdacd-409c-4367-8387-8ef6acaa4412 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:22.543872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdacd-409c-4367-8387-8ef6acaa4412 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:22.549714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5e341-e9e0-4aee-8144-227cb8f3cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:22.553629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5e341-e9e0-4aee-8144-227cb8f3cfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.553629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5e341-e9e0-4aee-8144-227cb8f3cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.553629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5e341-e9e0-4aee-8144-227cb8f3cfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.553629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5e341-e9e0-4aee-8144-227cb8f3cfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:22.553629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5e341-e9e0-4aee-8144-227cb8f3cfe4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:22.567820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1254/2520] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:22.572654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b0c9-6cbf-41b9-842f-f8f1b8bd84bf admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:22.587704 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0b0c9-6cbf-41b9-842f-f8f1b8bd84bf admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:22.593042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1571c9-f12b-4095-9d4d-00fce727abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:22.594275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1571c9-f12b-4095-9d4d-00fce727abfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.594552 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1571c9-f12b-4095-9d4d-00fce727abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.594879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1571c9-f12b-4095-9d4d-00fce727abfc admin admin] PATH_INFO: `/v3/projects/8f28d4dd16514aef912af719921491d2/users/b6911548896a47409a9ba54d7000116a/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.608048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:22.614112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1571c9-f12b-4095-9d4d-00fce727abfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f28d4dd16514aef912af719921491d2, user_id=b6911548896a47409a9ba54d7000116a, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:22.617756 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1571c9-f12b-4095-9d4d-00fce727abfc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:22.702362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1267/2521] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:22 2022] PUT /identity/v3/projects/8f28d4dd16514aef912af719921491d2/users/b6911548896a47409a9ba54d7000116a/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:22.715044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cacf-74fb-4f31-834c-1e6df615d783 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.715752 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cacf-74fb-4f31-834c-1e6df615d783 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.716284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cacf-74fb-4f31-834c-1e6df615d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.751713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5f63cacf-74fb-4f31-834c-1e6df615d783 None None] MFA Rules not processed for user `b6911548896a47409a9ba54d7000116a`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:22.752905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5f63cacf-74fb-4f31-834c-1e6df615d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:22.832052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1255/2522] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:22.837888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1571c9-f12b-4095-9d4d-00fce727abfc admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:22.912082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1571c9-f12b-4095-9d4d-00fce727abfc admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:22.917561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f4df6-9301-4c58-98ec-b76f6b08ec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:22.918274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4df6-9301-4c58-98ec-b76f6b08ec66 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:22.918486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4df6-9301-4c58-98ec-b76f6b08ec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:22.918760 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4df6-9301-4c58-98ec-b76f6b08ec66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:22.919385 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f4df6-9301-4c58-98ec-b76f6b08ec66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:22.921360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f4df6-9301-4c58-98ec-b76f6b08ec66 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:23.011809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1268/2523] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:23.017460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63cacf-74fb-4f31-834c-1e6df615d783 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:23.038733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63cacf-74fb-4f31-834c-1e6df615d783 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:23.121165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fdaf9-43dd-45a2-a420-dd2a7e3abce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:23.121812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fdaf9-43dd-45a2-a420-dd2a7e3abce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:23.122092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fdaf9-43dd-45a2-a420-dd2a7e3abce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:23.122363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fdaf9-43dd-45a2-a420-dd2a7e3abce6 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:23.122997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fdaf9-43dd-45a2-a420-dd2a7e3abce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:23.125573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fdaf9-43dd-45a2-a420-dd2a7e3abce6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:23.140248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:23.263690 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1256/2524] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:23 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:23.268768 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f4df6-9301-4c58-98ec-b76f6b08ec66 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:23.280191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f4df6-9301-4c58-98ec-b76f6b08ec66 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:23.287655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cef9f-9480-494e-bc09-783782032591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:23.288291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cef9f-9480-494e-bc09-783782032591 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:23.288624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cef9f-9480-494e-bc09-783782032591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:23.288918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cef9f-9480-494e-bc09-783782032591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:23.289763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cef9f-9480-494e-bc09-783782032591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:23.291529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cef9f-9480-494e-bc09-783782032591 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:23.308280 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1269/2525] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:23.309710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fdaf9-43dd-45a2-a420-dd2a7e3abce6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:23.320818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fdaf9-43dd-45a2-a420-dd2a7e3abce6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:23.325572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e5fdb-519e-401c-9c4c-c4c7da609509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:23.326235 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e5fdb-519e-401c-9c4c-c4c7da609509 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:23.326513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e5fdb-519e-401c-9c4c-c4c7da609509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:23.326784 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e5fdb-519e-401c-9c4c-c4c7da609509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:23.327605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e5fdb-519e-401c-9c4c-c4c7da609509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:23.329328 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e5fdb-519e-401c-9c4c-c4c7da609509 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:23.340944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1257/2526] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:23.346110 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cef9f-9480-494e-bc09-783782032591 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:23.356818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cef9f-9480-494e-bc09-783782032591 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:23.361684 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4b82e-e115-4b19-9c7a-ae170d037c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:23.362361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4b82e-e115-4b19-9c7a-ae170d037c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:23.362662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4b82e-e115-4b19-9c7a-ae170d037c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:23.362937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4b82e-e115-4b19-9c7a-ae170d037c15 admin admin] PATH_INFO: `/v3/projects/f95380d2ce36416e836ef2134c00b862/users/3a1b3022d01a4d5b835fbf1c9651441f/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:23.379536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4b82e-e115-4b19-9c7a-ae170d037c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95380d2ce36416e836ef2134c00b862, user_id=3a1b3022d01a4d5b835fbf1c9651441f, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:23.382606 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4b82e-e115-4b19-9c7a-ae170d037c15 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:23.738307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1270/2527] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:23 2022] PUT /identity/v3/projects/f95380d2ce36416e836ef2134c00b862/users/3a1b3022d01a4d5b835fbf1c9651441f/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:23.748845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd69a-ec55-4879-9665-96817d3b410f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:23.749135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd69a-ec55-4879-9665-96817d3b410f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:23.749439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd69a-ec55-4879-9665-96817d3b410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:23.778650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-7f0cd69a-ec55-4879-9665-96817d3b410f None None] MFA Rules not processed for user `3a1b3022d01a4d5b835fbf1c9651441f`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:23.783158 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7f0cd69a-ec55-4879-9665-96817d3b410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:23.879313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1258/2528] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:23.880097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4b82e-e115-4b19-9c7a-ae170d037c15 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:23.952322 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4b82e-e115-4b19-9c7a-ae170d037c15 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:23.957535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dda80c-f1d7-407f-8bbf-0a94a738f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:23.958406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dda80c-f1d7-407f-8bbf-0a94a738f596 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:23.958767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dda80c-f1d7-407f-8bbf-0a94a738f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:23.959120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dda80c-f1d7-407f-8bbf-0a94a738f596 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:23.959828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dda80c-f1d7-407f-8bbf-0a94a738f596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:23.961819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dda80c-f1d7-407f-8bbf-0a94a738f596 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:24.072396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1271/2529] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:23 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:24.076085 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cd69a-ec55-4879-9665-96817d3b410f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:24.087794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cd69a-ec55-4879-9665-96817d3b410f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:24.166777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c1551-0b3f-4559-97ec-ccb2ed067fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:24.167353 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1551-0b3f-4559-97ec-ccb2ed067fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:24.167684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1551-0b3f-4559-97ec-ccb2ed067fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:24.168234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c1551-0b3f-4559-97ec-ccb2ed067fcf admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:24.168618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c1551-0b3f-4559-97ec-ccb2ed067fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:24.170562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c1551-0b3f-4559-97ec-ccb2ed067fcf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:24.263592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1259/2530] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:24 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:24.264541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dda80c-f1d7-407f-8bbf-0a94a738f596 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:24.282250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dda80c-f1d7-407f-8bbf-0a94a738f596 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:24.287650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1b941-a929-4b4e-8742-30b134661db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:24.288625 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1b941-a929-4b4e-8742-30b134661db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:24.288910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1b941-a929-4b4e-8742-30b134661db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:24.289262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1b941-a929-4b4e-8742-30b134661db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:24.290072 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1b941-a929-4b4e-8742-30b134661db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:24.291824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1b941-a929-4b4e-8742-30b134661db1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:24.304281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1272/2531] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:24.308319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c1551-0b3f-4559-97ec-ccb2ed067fcf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:24.320333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c1551-0b3f-4559-97ec-ccb2ed067fcf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:24.325287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8fb3b-283b-45c9-b35a-f789300efb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:24.325988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8fb3b-283b-45c9-b35a-f789300efb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:24.326290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8fb3b-283b-45c9-b35a-f789300efb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:24.326550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8fb3b-283b-45c9-b35a-f789300efb6e admin admin] PATH_INFO: `/v3/projects/ee8cb98ea2084db4bc985a28acd0c0bd/users/e4df1b12d9414334916c4a047ec32065/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:24.345144 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8fb3b-283b-45c9-b35a-f789300efb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb98ea2084db4bc985a28acd0c0bd, user_id=e4df1b12d9414334916c4a047ec32065, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:24.348286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8fb3b-283b-45c9-b35a-f789300efb6e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:24.445260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1260/2532] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:24 2022] PUT /identity/v3/projects/ee8cb98ea2084db4bc985a28acd0c0bd/users/e4df1b12d9414334916c4a047ec32065/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:24.450131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1b941-a929-4b4e-8742-30b134661db1 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:24.465191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1b941-a929-4b4e-8742-30b134661db1 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:24.480813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:24.534133 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d999dc-41ad-43d5-8efb-f29ffe605700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:24.534641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d999dc-41ad-43d5-8efb-f29ffe605700 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:24.534949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d999dc-41ad-43d5-8efb-f29ffe605700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:24.535432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d999dc-41ad-43d5-8efb-f29ffe605700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:24.536100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d999dc-41ad-43d5-8efb-f29ffe605700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:24.538258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d999dc-41ad-43d5-8efb-f29ffe605700 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:24.549842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1273/2533] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:24.554362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8fb3b-283b-45c9-b35a-f789300efb6e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:24.566329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8fb3b-283b-45c9-b35a-f789300efb6e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:24.571274 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:24.571924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:24.572271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:24.572559 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] PATH_INFO: `/v3/projects/ee8cb98ea2084db4bc985a28acd0c0bd/users/e4df1b12d9414334916c4a047ec32065/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:24.574589 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb98ea2084db4bc985a28acd0c0bd, user_id=e4df1b12d9414334916c4a047ec32065, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:24.577394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:24.590436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1261/2534] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:24 2022] PUT /identity/v3/projects/ee8cb98ea2084db4bc985a28acd0c0bd/users/e4df1b12d9414334916c4a047ec32065/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:24.602167 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d91bc-43cc-404a-81f6-8b264ea6e170 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:24.602673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d91bc-43cc-404a-81f6-8b264ea6e170 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:24.602961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d91bc-43cc-404a-81f6-8b264ea6e170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:24.636746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-7b0d91bc-43cc-404a-81f6-8b264ea6e170 None None] MFA Rules not processed for user `e4df1b12d9414334916c4a047ec32065`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:24.638673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7b0d91bc-43cc-404a-81f6-8b264ea6e170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:24.722467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1274/2535] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:24.733449 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:24.735310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:24.768483 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:24.806607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced286da-9493-4cd9-8c5d-1bd8c67d8878 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:24.811193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf352a-18ea-4d3d-8091-e21fa7a2709e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:24.812672 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf352a-18ea-4d3d-8091-e21fa7a2709e service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:24.813068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf352a-18ea-4d3d-8091-e21fa7a2709e service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:24.813419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf352a-18ea-4d3d-8091-e21fa7a2709e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:24.824178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf352a-18ea-4d3d-8091-e21fa7a2709e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:24.825937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf352a-18ea-4d3d-8091-e21fa7a2709e service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:24.836506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1262/2536] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:24.951095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d91bc-43cc-404a-81f6-8b264ea6e170 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:24.951685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7b0d91bc-43cc-404a-81f6-8b264ea6e170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:24.966665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d91bc-43cc-404a-81f6-8b264ea6e170 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:24.972436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:24.973337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:24.973562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:24.974024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:25.062873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:25.064318 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:25.074910 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1275/2537] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:28.823012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9515-c7a2-4235-8420-7ed7ffa8575b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:28.823496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9515-c7a2-4235-8420-7ed7ffa8575b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:28.823640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb9515-c7a2-4235-8420-7ed7ffa8575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:28.843041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e5eb9515-c7a2-4235-8420-7ed7ffa8575b None None] MFA Rules not processed for user `cc5ff4a4b258472d90e7e9efd94d8808`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:28.844278 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e5eb9515-c7a2-4235-8420-7ed7ffa8575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:28.901997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1263/2538] 10.222.0.61 () {58 vars in 967 bytes} [Tue Aug 23 16:41:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:28.914250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:28.915711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:28.955073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:28.988589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786db34d-b58d-45e7-8516-7130bf4ad249 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:28.993654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818841d3-1e45-4219-a6a8-baa195995a90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8442dc046cb64619b62823b8bcc7cc4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:28.994298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818841d3-1e45-4219-a6a8-baa195995a90 service swift] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:28.994578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818841d3-1e45-4219-a6a8-baa195995a90 service swift] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:28.994854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818841d3-1e45-4219-a6a8-baa195995a90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:29.003725 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818841d3-1e45-4219-a6a8-baa195995a90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:29.005526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818841d3-1e45-4219-a6a8-baa195995a90 service swift] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:29.013990 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1276/2539] 10.222.0.61 () {60 vars in 1384 bytes} [Tue Aug 23 16:41:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:41:29.487969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9515-c7a2-4235-8420-7ed7ffa8575b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:29.554060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb9515-c7a2-4235-8420-7ed7ffa8575b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:29.558582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:29.559208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:29.559491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:29.559764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] PATH_INFO: `/v3/users/b6911548896a47409a9ba54d7000116a` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:29.560880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6911548896a47409a9ba54d7000116a)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:29.563312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:29.813763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6911548896a47409a9ba54d7000116a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:29.820725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6911548896a47409a9ba54d7000116a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:29.821390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6911548896a47409a9ba54d7000116a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:29.822019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6911548896a47409a9ba54d7000116a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:29.834561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6911548896a47409a9ba54d7000116a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:29.836269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:29.957783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1264/2540] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:29 2022] DELETE /identity/v3/users/b6911548896a47409a9ba54d7000116a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:29.962170 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef64130-a49e-491a-a3e9-fd06a0235170 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:29.962632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef64130-a49e-491a-a3e9-fd06a0235170 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:29.962729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef64130-a49e-491a-a3e9-fd06a0235170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:29.981509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-9ef64130-a49e-491a-a3e9-fd06a0235170 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:29.982722 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9ef64130-a49e-491a-a3e9-fd06a0235170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:30.040468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1277/2541] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:30.050669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:30.052397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:30.117464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eded665-1821-49b9-a9e7-3b5a46283ffd admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:30.121096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5327c-3467-4e45-ab93-6d9a478ce1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:30.121725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5327c-3467-4e45-ab93-6d9a478ce1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:30.122007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5327c-3467-4e45-ab93-6d9a478ce1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:30.122280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5327c-3467-4e45-ab93-6d9a478ce1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:30.131381 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5327c-3467-4e45-ab93-6d9a478ce1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:30.132796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5327c-3467-4e45-ab93-6d9a478ce1e5 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:30.143671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1265/2542] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:30.584234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef64130-a49e-491a-a3e9-fd06a0235170 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:30.585890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9ef64130-a49e-491a-a3e9-fd06a0235170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:30.608157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef64130-a49e-491a-a3e9-fd06a0235170 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:30.625548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:30.626329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:30.627488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:30.637798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] PATH_INFO: `/v3/projects/8f28d4dd16514aef912af719921491d2` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:30.639315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f28d4dd16514aef912af719921491d2)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:30.641843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:30.800646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f28d4dd16514aef912af719921491d2', 'request_id': 'req-38c143af-085b-48bd-9759-34f5c73ca3c9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:30.807720 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f28d4dd16514aef912af719921491d2', 'request_id': 'req-38c143af-085b-48bd-9759-34f5c73ca3c9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:30.885539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f28d4dd16514aef912af719921491d2', 'request_id': 'req-38c143af-085b-48bd-9759-34f5c73ca3c9'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:30.898296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] The token cache is being invalidate because project 8f28d4dd16514aef912af719921491d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:30.898590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:30.899227 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:30.900963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1278/2543] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:30 2022] DELETE /identity/v3/projects/8f28d4dd16514aef912af719921491d2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:30.904833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5327c-3467-4e45-ab93-6d9a478ce1e5 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:30.914812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5327c-3467-4e45-ab93-6d9a478ce1e5 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:30.975612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:30.976253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:30.976540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:30.976816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] PATH_INFO: `/v3/users/3a1b3022d01a4d5b835fbf1c9651441f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:30.977990 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1b3022d01a4d5b835fbf1c9651441f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:30.979955 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:31.166312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1b3022d01a4d5b835fbf1c9651441f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:31.173795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1b3022d01a4d5b835fbf1c9651441f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:31.174576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1b3022d01a4d5b835fbf1c9651441f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:31.175263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1b3022d01a4d5b835fbf1c9651441f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:31.188155 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1b3022d01a4d5b835fbf1c9651441f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:31.260440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1266/2544] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:30 2022] DELETE /identity/v3/users/3a1b3022d01a4d5b835fbf1c9651441f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:31.730337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:31.731818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:31.745206 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c143af-085b-48bd-9759-34f5c73ca3c9 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:31.790837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:31.804819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:31.805456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:31.805775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:31.806048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] PATH_INFO: `/v3/projects/f95380d2ce36416e836ef2134c00b862` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:31.807174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95380d2ce36416e836ef2134c00b862)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:31.809085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:31.926371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95380d2ce36416e836ef2134c00b862', 'request_id': 'req-7899b06b-b173-4f02-9d24-5be91c115176'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:31.932513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95380d2ce36416e836ef2134c00b862', 'request_id': 'req-7899b06b-b173-4f02-9d24-5be91c115176'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.050784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95380d2ce36416e836ef2134c00b862', 'request_id': 'req-7899b06b-b173-4f02-9d24-5be91c115176'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.061727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] The token cache is being invalidate because project f95380d2ce36416e836ef2134c00b862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:32.062022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.062660 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.064368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1279/2545] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:31 2022] DELETE /identity/v3/projects/f95380d2ce36416e836ef2134c00b862 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:32.068134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:32.069712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:32.082800 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9548e3-f3c3-466c-8f60-e0e5176d2753 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:32.091806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:32.138791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:32.139464 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:32.140204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:32.140472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] PATH_INFO: `/v3/users/e4df1b12d9414334916c4a047ec32065` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:32.141577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4df1b12d9414334916c4a047ec32065)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:32.143525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:32.495111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4df1b12d9414334916c4a047ec32065'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.501912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4df1b12d9414334916c4a047ec32065'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.502598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4df1b12d9414334916c4a047ec32065'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.503213 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4df1b12d9414334916c4a047ec32065'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.516493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4df1b12d9414334916c4a047ec32065'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.577006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:32.578604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:32.591769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899b06b-b173-4f02-9d24-5be91c115176 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:32.597406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:32.597746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:32.598079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:32.598357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] PATH_INFO: `/v3/users/ca11ea548a94415cadb14f3e5266198b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:32.599505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca11ea548a94415cadb14f3e5266198b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:32.601420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:32.623277 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1267/2546] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:32 2022] DELETE /identity/v3/users/e4df1b12d9414334916c4a047ec32065 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:32.911175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca11ea548a94415cadb14f3e5266198b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.912310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca11ea548a94415cadb14f3e5266198b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:32.913197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca11ea548a94415cadb14f3e5266198b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.220391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca11ea548a94415cadb14f3e5266198b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.227692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:33.229405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:33.239618 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca11ea548a94415cadb14f3e5266198b'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.247985 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1280/2547] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:32 2022] DELETE /identity/v3/users/ca11ea548a94415cadb14f3e5266198b => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:33.350849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb178a-072a-42bb-815c-5d8778eaadac admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:33.409766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:33.431157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:33.431712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.431999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.432333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] PATH_INFO: `/v3/projects/ee8cb98ea2084db4bc985a28acd0c0bd` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.433439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8cb98ea2084db4bc985a28acd0c0bd)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:33.435423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:33.527181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:33.529293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:33.547199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73e3af-84df-4028-b54a-f02a4f141ea9 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:33.565331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:33.565331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.565331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.565331 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] PATH_INFO: `/v3/projects/90ca1d426bc64bd69d3700cb368f4794` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.566138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ca1d426bc64bd69d3700cb368f4794)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:33.566138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:33.566885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8cb98ea2084db4bc985a28acd0c0bd', 'request_id': 'req-4153ad01-57e3-4854-b3b1-aeb93f635e8b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.668097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8cb98ea2084db4bc985a28acd0c0bd', 'request_id': 'req-4153ad01-57e3-4854-b3b1-aeb93f635e8b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.675844 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8cb98ea2084db4bc985a28acd0c0bd', 'request_id': 'req-4153ad01-57e3-4854-b3b1-aeb93f635e8b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.683198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:33.686717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] The token cache is being invalidate because project ee8cb98ea2084db4bc985a28acd0c0bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:33.686964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ca1d426bc64bd69d3700cb368f4794', 'request_id': 'req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.687080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.687660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4153ad01-57e3-4854-b3b1-aeb93f635e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.690069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1268/2548] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:33 2022] DELETE /identity/v3/projects/ee8cb98ea2084db4bc985a28acd0c0bd => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:33.694609 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ca1d426bc64bd69d3700cb368f4794', 'request_id': 'req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.696041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55809f-46fb-404d-bece-fa61b58994bd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.696331 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55809f-46fb-404d-bece-fa61b58994bd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.696613 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55809f-46fb-404d-bece-fa61b58994bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.715980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-1b55809f-46fb-404d-bece-fa61b58994bd None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:33.717268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-1b55809f-46fb-404d-bece-fa61b58994bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:33.775645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1269/2549] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:33.781833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ca1d426bc64bd69d3700cb368f4794', 'request_id': 'req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.783767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150575f-b27e-4e3d-93eb-f054deec1d79 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.784060 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150575f-b27e-4e3d-93eb-f054deec1d79 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.784341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150575f-b27e-4e3d-93eb-f054deec1d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.793865 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] The token cache is being invalidate because project 90ca1d426bc64bd69d3700cb368f4794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:33.794163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.794812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3d39fab6-17ac-415f-8c5d-2e36b9411dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:33.796856 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1281/2550] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:33 2022] DELETE /identity/v3/projects/90ca1d426bc64bd69d3700cb368f4794 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:33.803713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5f8e-4cd9-4a6d-b254-a9bad89d5889 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.804002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5f8e-4cd9-4a6d-b254-a9bad89d5889 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.804278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5f8e-4cd9-4a6d-b254-a9bad89d5889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.805689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-2150575f-b27e-4e3d-93eb-f054deec1d79 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:33.806886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-2150575f-b27e-4e3d-93eb-f054deec1d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:33.815703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1270/2551] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:33.819712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150575f-b27e-4e3d-93eb-f054deec1d79 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:33.825880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e5ff5f8e-4cd9-4a6d-b254-a9bad89d5889 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:33.827090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e5ff5f8e-4cd9-4a6d-b254-a9bad89d5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:33.829078 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150575f-b27e-4e3d-93eb-f054deec1d79 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:33.833673 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:33.834684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.834684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.834909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.835156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1282/2552] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:33.835557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:41:33.835859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:33.837461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:33.842307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215929-2f83-4697-9bf3-5cab292975bc None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.843178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215929-2f83-4697-9bf3-5cab292975bc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.843541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215929-2f83-4697-9bf3-5cab292975bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.853346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1271/2553] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:41:33.854312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:33.863220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-47215929-2f83-4697-9bf3-5cab292975bc None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:33.864428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-47215929-2f83-4697-9bf3-5cab292975bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:33.869371 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60835e-c279-4c7b-94c7-6dce5562c72e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:33.869739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516fb63-4ef0-4381-b821-c4fe2a17fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:33.870356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516fb63-4ef0-4381-b821-c4fe2a17fafc admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.870637 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516fb63-4ef0-4381-b821-c4fe2a17fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.870904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516fb63-4ef0-4381-b821-c4fe2a17fafc admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.871572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516fb63-4ef0-4381-b821-c4fe2a17fafc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:33.872670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1283/2554] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:33.875926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516fb63-4ef0-4381-b821-c4fe2a17fafc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:33.876831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47215929-2f83-4697-9bf3-5cab292975bc None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:33.885838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47215929-2f83-4697-9bf3-5cab292975bc None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:33.890775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:33.891371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.891645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.891915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.892558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:41:33.892859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:33.894516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:33.906305 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1284/2555] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:41:33.910586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:33.919841 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cceba-b4e3-46c8-a2b5-1993d45e8f32 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:33.925277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542a9af-555e-44dc-9cf9-465b58ea7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:33.925874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a9af-555e-44dc-9cf9-465b58ea7caf admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:33.926166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a9af-555e-44dc-9cf9-465b58ea7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:33.926435 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a9af-555e-44dc-9cf9-465b58ea7caf admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:33.927053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542a9af-555e-44dc-9cf9-465b58ea7caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:33.929002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542a9af-555e-44dc-9cf9-465b58ea7caf admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:33.965893 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1272/2556] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:33 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:33.970438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516fb63-4ef0-4381-b821-c4fe2a17fafc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.030783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516fb63-4ef0-4381-b821-c4fe2a17fafc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.035411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb97ac-0043-4658-882e-f19bc3d57c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.036011 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb97ac-0043-4658-882e-f19bc3d57c66 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.036306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb97ac-0043-4658-882e-f19bc3d57c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.036588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb97ac-0043-4658-882e-f19bc3d57c66 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.037245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb97ac-0043-4658-882e-f19bc3d57c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.039250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb97ac-0043-4658-882e-f19bc3d57c66 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.073814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:34.080776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1285/2557] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:33 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:34.084808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542a9af-555e-44dc-9cf9-465b58ea7caf admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.145566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542a9af-555e-44dc-9cf9-465b58ea7caf admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.150219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9715e2-11a6-455e-a2b4-68f66d2a4f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.150813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9715e2-11a6-455e-a2b4-68f66d2a4f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.151091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9715e2-11a6-455e-a2b4-68f66d2a4f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.151362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9715e2-11a6-455e-a2b4-68f66d2a4f28 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.152046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9715e2-11a6-455e-a2b4-68f66d2a4f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.153987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9715e2-11a6-455e-a2b4-68f66d2a4f28 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.175733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1273/2558] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:33 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:34.181293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb97ac-0043-4658-882e-f19bc3d57c66 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.189503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb97ac-0043-4658-882e-f19bc3d57c66 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.194270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1607-0145-4e64-a809-1df310b46901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.194905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1607-0145-4e64-a809-1df310b46901 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.195183 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1607-0145-4e64-a809-1df310b46901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.195477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1607-0145-4e64-a809-1df310b46901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.196096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a1607-0145-4e64-a809-1df310b46901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.197728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a1607-0145-4e64-a809-1df310b46901 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.208149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1274/2559] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:34.212166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1607-0145-4e64-a809-1df310b46901 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.221968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1607-0145-4e64-a809-1df310b46901 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.226529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bd18-d9d0-42aa-9ad9-44736fa5ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.227079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bd18-d9d0-42aa-9ad9-44736fa5ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.227357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bd18-d9d0-42aa-9ad9-44736fa5ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.227625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bd18-d9d0-42aa-9ad9-44736fa5ff90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.228234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bd18-d9d0-42aa-9ad9-44736fa5ff90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.229820 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bd18-d9d0-42aa-9ad9-44736fa5ff90 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.239951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1275/2560] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:34.243958 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bd18-d9d0-42aa-9ad9-44736fa5ff90 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.253092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bd18-d9d0-42aa-9ad9-44736fa5ff90 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.257712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b107a-2979-4870-bfc1-5ad164ba57e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.258327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b107a-2979-4870-bfc1-5ad164ba57e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.258641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b107a-2979-4870-bfc1-5ad164ba57e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.258917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b107a-2979-4870-bfc1-5ad164ba57e6 admin admin] PATH_INFO: `/v3/projects/ec0287a45a534a8d9180e1f3a82c7177/users/c47e51fa4dde4e75862a469b14b160bd/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.273891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b107a-2979-4870-bfc1-5ad164ba57e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0287a45a534a8d9180e1f3a82c7177, user_id=c47e51fa4dde4e75862a469b14b160bd, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.276557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b107a-2979-4870-bfc1-5ad164ba57e6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.282884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1286/2561] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:34 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:34.283829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9715e2-11a6-455e-a2b4-68f66d2a4f28 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.293561 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9715e2-11a6-455e-a2b4-68f66d2a4f28 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.298621 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25b847-24d5-425f-960b-0bc34f0f1d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.299211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25b847-24d5-425f-960b-0bc34f0f1d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.299498 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25b847-24d5-425f-960b-0bc34f0f1d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.299796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25b847-24d5-425f-960b-0bc34f0f1d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.300431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25b847-24d5-425f-960b-0bc34f0f1d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.302127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25b847-24d5-425f-960b-0bc34f0f1d60 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.312023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1287/2562] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:34.315560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25b847-24d5-425f-960b-0bc34f0f1d60 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.324731 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25b847-24d5-425f-960b-0bc34f0f1d60 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.329830 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1d95-aaaa-4c38-a977-ebb5e2fe077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.330375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1d95-aaaa-4c38-a977-ebb5e2fe077c admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.330655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1d95-aaaa-4c38-a977-ebb5e2fe077c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.330925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1d95-aaaa-4c38-a977-ebb5e2fe077c admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.331530 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c1d95-aaaa-4c38-a977-ebb5e2fe077c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.333049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c1d95-aaaa-4c38-a977-ebb5e2fe077c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.343391 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1288/2563] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:34.347120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1d95-aaaa-4c38-a977-ebb5e2fe077c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.358056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1d95-aaaa-4c38-a977-ebb5e2fe077c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.363563 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c207293-0ea0-4e28-8d18-0341c1275477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.364325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207293-0ea0-4e28-8d18-0341c1275477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.364607 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207293-0ea0-4e28-8d18-0341c1275477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.364876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c207293-0ea0-4e28-8d18-0341c1275477 admin admin] PATH_INFO: `/v3/projects/894ec69ece9e4048baa11e16e4a21c91/users/33825f7a381f471cb0e66c1c3dc18aca/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.372434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1276/2564] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:34 2022] PUT /identity/v3/projects/ec0287a45a534a8d9180e1f3a82c7177/users/c47e51fa4dde4e75862a469b14b160bd/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:34.384389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916f99-6331-410c-84f4-73481b81ec93 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.384757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916f99-6331-410c-84f4-73481b81ec93 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.385247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88916f99-6331-410c-84f4-73481b81ec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.392014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c207293-0ea0-4e28-8d18-0341c1275477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894ec69ece9e4048baa11e16e4a21c91, user_id=33825f7a381f471cb0e66c1c3dc18aca, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.396623 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c207293-0ea0-4e28-8d18-0341c1275477 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.414267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-88916f99-6331-410c-84f4-73481b81ec93 None None] MFA Rules not processed for user `c47e51fa4dde4e75862a469b14b160bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:34.416333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-88916f99-6331-410c-84f4-73481b81ec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:34.481700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1277/2565] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:34.493363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88916f99-6331-410c-84f4-73481b81ec93 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.494807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-88916f99-6331-410c-84f4-73481b81ec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:34.506067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1289/2566] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:34 2022] PUT /identity/v3/projects/894ec69ece9e4048baa11e16e4a21c91/users/33825f7a381f471cb0e66c1c3dc18aca/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:34.520110 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc3811-9cb9-448f-83c2-62460dea1e27 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.520403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc3811-9cb9-448f-83c2-62460dea1e27 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.520678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc3811-9cb9-448f-83c2-62460dea1e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.550853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d3dc3811-9cb9-448f-83c2-62460dea1e27 None None] MFA Rules not processed for user `33825f7a381f471cb0e66c1c3dc18aca`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:34.550853 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d3dc3811-9cb9-448f-83c2-62460dea1e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:34.554897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88916f99-6331-410c-84f4-73481b81ec93 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.564160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:34.605015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4843e26-7b58-415b-8b39-40715eb7d272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.606056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843e26-7b58-415b-8b39-40715eb7d272 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.606335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843e26-7b58-415b-8b39-40715eb7d272 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.606608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4843e26-7b58-415b-8b39-40715eb7d272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.618290 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1290/2567] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:34.629996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc3811-9cb9-448f-83c2-62460dea1e27 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:34.631364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d3dc3811-9cb9-448f-83c2-62460dea1e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:34.644334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc3811-9cb9-448f-83c2-62460dea1e27 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:34.648053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b8678-fefe-4165-bc5c-0d000279f943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:34.648708 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b8678-fefe-4165-bc5c-0d000279f943 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:34.648991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b8678-fefe-4165-bc5c-0d000279f943 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:34.649271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b8678-fefe-4165-bc5c-0d000279f943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:34.657727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b8678-fefe-4165-bc5c-0d000279f943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.659154 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b8678-fefe-4165-bc5c-0d000279f943 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.664390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4843e26-7b58-415b-8b39-40715eb7d272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:34.665862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4843e26-7b58-415b-8b39-40715eb7d272 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:34.668386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1291/2568] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:41:34.676682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1278/2569] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:41:34.781658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:43.189767 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b8678-fefe-4165-bc5c-0d000279f943 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:43.277554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b8678-fefe-4165-bc5c-0d000279f943 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:43.283313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:43.284119 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:43.284505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:43.284997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] PATH_INFO: `/v3/users/c47e51fa4dde4e75862a469b14b160bd` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:43.286277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47e51fa4dde4e75862a469b14b160bd)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:43.289369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:43.498504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47e51fa4dde4e75862a469b14b160bd'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:43.499172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47e51fa4dde4e75862a469b14b160bd'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:43.499786 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47e51fa4dde4e75862a469b14b160bd'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:43.574845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47e51fa4dde4e75862a469b14b160bd'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:43.589251 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47e51fa4dde4e75862a469b14b160bd'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:43.610595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1292/2570] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:43 2022] DELETE /identity/v3/users/c47e51fa4dde4e75862a469b14b160bd => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:43.615329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5674aa-18ad-4959-8dc4-c0356b56096d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:43.615840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5674aa-18ad-4959-8dc4-c0356b56096d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:43.615935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5674aa-18ad-4959-8dc4-c0356b56096d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:43.643722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0d5674aa-18ad-4959-8dc4-c0356b56096d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:43.643722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0d5674aa-18ad-4959-8dc4-c0356b56096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:43.732463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1279/2571] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:43.743311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:43.744979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:43.779349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:43.831595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbca01-6d50-4836-8d1e-fa84d0a6b2d6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:43.836099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e1560-0b10-44cc-b16c-155046bebe51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:43.836717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1560-0b10-44cc-b16c-155046bebe51 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:43.836991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1560-0b10-44cc-b16c-155046bebe51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:43.837268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1560-0b10-44cc-b16c-155046bebe51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:43.847166 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e1560-0b10-44cc-b16c-155046bebe51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:43.848829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e1560-0b10-44cc-b16c-155046bebe51 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:43.858642 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1293/2572] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:44.281732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5674aa-18ad-4959-8dc4-c0356b56096d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:44.283342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0d5674aa-18ad-4959-8dc4-c0356b56096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:44.298556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5674aa-18ad-4959-8dc4-c0356b56096d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:44.305894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:44.306561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:44.306847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:44.307190 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] PATH_INFO: `/v3/projects/ec0287a45a534a8d9180e1f3a82c7177` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:44.308459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0287a45a534a8d9180e1f3a82c7177)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:44.310691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:44.599529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0287a45a534a8d9180e1f3a82c7177', 'request_id': 'req-21ce41e2-8518-4942-a415-4d419221abb9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:44.684687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0287a45a534a8d9180e1f3a82c7177', 'request_id': 'req-21ce41e2-8518-4942-a415-4d419221abb9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:44.691707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0287a45a534a8d9180e1f3a82c7177', 'request_id': 'req-21ce41e2-8518-4942-a415-4d419221abb9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:44.696535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:44.703264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] The token cache is being invalidate because project ec0287a45a534a8d9180e1f3a82c7177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:44.703566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:44.704335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-21ce41e2-8518-4942-a415-4d419221abb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:44.706136 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1280/2573] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:44 2022] DELETE /identity/v3/projects/ec0287a45a534a8d9180e1f3a82c7177 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:44.711199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee41f-70ac-48f9-882a-e7073cb15e35 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:44.711748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee41f-70ac-48f9-882a-e7073cb15e35 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:44.711748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee41f-70ac-48f9-882a-e7073cb15e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:44.732288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-339ee41f-70ac-48f9-882a-e7073cb15e35 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:44.733556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-339ee41f-70ac-48f9-882a-e7073cb15e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:44.796619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1294/2574] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:44.805227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503115-bbe3-4d85-8886-7f03b2fd06d4 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:44.808445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503115-bbe3-4d85-8886-7f03b2fd06d4 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:44.808445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd503115-bbe3-4d85-8886-7f03b2fd06d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:44.826909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-cd503115-bbe3-4d85-8886-7f03b2fd06d4 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:44.828171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cd503115-bbe3-4d85-8886-7f03b2fd06d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:44.838231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1281/2575] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:44.845789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee41f-70ac-48f9-882a-e7073cb15e35 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:44.861175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee41f-70ac-48f9-882a-e7073cb15e35 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:44.872191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:44.872821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:44.873115 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:44.873410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:44.874113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:41:44.874422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:44.876052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:44.888430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1295/2576] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:41:44.893443 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd503115-bbe3-4d85-8886-7f03b2fd06d4 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:44.902562 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd503115-bbe3-4d85-8886-7f03b2fd06d4 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:44.907951 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402424d0-97b3-4365-9b33-9e6096a3a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:44.908547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402424d0-97b3-4365-9b33-9e6096a3a25f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:44.908830 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402424d0-97b3-4365-9b33-9e6096a3a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:44.909104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402424d0-97b3-4365-9b33-9e6096a3a25f admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:44.909898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402424d0-97b3-4365-9b33-9e6096a3a25f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:44.911796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402424d0-97b3-4365-9b33-9e6096a3a25f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:45.050771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1282/2577] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:44 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:45.051932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:45.069595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6c235-73b9-4a72-92fa-49018adf0973 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:45.138192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996bfb-8628-41f2-965f-47a92f7b79db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:45.138813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996bfb-8628-41f2-965f-47a92f7b79db admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:45.139744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996bfb-8628-41f2-965f-47a92f7b79db admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:45.140029 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996bfb-8628-41f2-965f-47a92f7b79db admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:45.140701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f996bfb-8628-41f2-965f-47a92f7b79db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:45.142661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f996bfb-8628-41f2-965f-47a92f7b79db admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:45.288709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1296/2578] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:45 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:45.292201 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402424d0-97b3-4365-9b33-9e6096a3a25f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:45.302715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402424d0-97b3-4365-9b33-9e6096a3a25f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:45.308480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dfbd3-2016-4f00-93a1-8b5ec9e8f228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:45.309087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dfbd3-2016-4f00-93a1-8b5ec9e8f228 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:45.309368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dfbd3-2016-4f00-93a1-8b5ec9e8f228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:45.309688 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dfbd3-2016-4f00-93a1-8b5ec9e8f228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:45.310453 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dfbd3-2016-4f00-93a1-8b5ec9e8f228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:45.312707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dfbd3-2016-4f00-93a1-8b5ec9e8f228 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:45.322982 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1283/2579] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:45.327778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996bfb-8628-41f2-965f-47a92f7b79db admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:45.338132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996bfb-8628-41f2-965f-47a92f7b79db admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:45.343253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bdd4c-1e34-4b93-9f2e-931590d48f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:45.343707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bdd4c-1e34-4b93-9f2e-931590d48f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:45.343995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bdd4c-1e34-4b93-9f2e-931590d48f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:45.344276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bdd4c-1e34-4b93-9f2e-931590d48f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:45.344932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bdd4c-1e34-4b93-9f2e-931590d48f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:45.346576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bdd4c-1e34-4b93-9f2e-931590d48f6a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:45.360207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1297/2580] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:45.361583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dfbd3-2016-4f00-93a1-8b5ec9e8f228 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:45.372134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dfbd3-2016-4f00-93a1-8b5ec9e8f228 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:45.381723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03767-cdee-443f-93ca-36df37bb1ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:45.383086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03767-cdee-443f-93ca-36df37bb1ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:45.383374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03767-cdee-443f-93ca-36df37bb1ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:45.383661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff03767-cdee-443f-93ca-36df37bb1ef2 admin admin] PATH_INFO: `/v3/projects/08cc808608e746c3ad86167c556e28d1/users/48f024c7f4e0446aa3fe38a3db44d8da/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:45.406703 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff03767-cdee-443f-93ca-36df37bb1ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08cc808608e746c3ad86167c556e28d1, user_id=48f024c7f4e0446aa3fe38a3db44d8da, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:45.410081 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff03767-cdee-443f-93ca-36df37bb1ef2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:45.542790 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1284/2581] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:45 2022] PUT /identity/v3/projects/08cc808608e746c3ad86167c556e28d1/users/48f024c7f4e0446aa3fe38a3db44d8da/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:45.553445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071cb46-14b6-42d1-835c-d8467e649f26 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:45.553847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071cb46-14b6-42d1-835c-d8467e649f26 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:45.554202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071cb46-14b6-42d1-835c-d8467e649f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:45.584562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-3071cb46-14b6-42d1-835c-d8467e649f26 None None] MFA Rules not processed for user `48f024c7f4e0446aa3fe38a3db44d8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:45.585816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3071cb46-14b6-42d1-835c-d8467e649f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:45.603742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:45.649974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1298/2582] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:45.654472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03767-cdee-443f-93ca-36df37bb1ef2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:45.722504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff03767-cdee-443f-93ca-36df37bb1ef2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:45.727338 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcdf1-94a8-4e25-bb47-7472ff54295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:45.727950 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcdf1-94a8-4e25-bb47-7472ff54295f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:45.728232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcdf1-94a8-4e25-bb47-7472ff54295f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:45.728507 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebcdf1-94a8-4e25-bb47-7472ff54295f admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:45.729365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebcdf1-94a8-4e25-bb47-7472ff54295f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:45.731477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebcdf1-94a8-4e25-bb47-7472ff54295f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:45.840480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1285/2583] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:45 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:45.845127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071cb46-14b6-42d1-835c-d8467e649f26 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:45.855781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071cb46-14b6-42d1-835c-d8467e649f26 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:45.910999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd090-6c5d-4b15-a582-e6bc7e2e9493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:45.911529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd090-6c5d-4b15-a582-e6bc7e2e9493 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:45.911824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd090-6c5d-4b15-a582-e6bc7e2e9493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:45.912097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cd090-6c5d-4b15-a582-e6bc7e2e9493 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:45.912735 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cd090-6c5d-4b15-a582-e6bc7e2e9493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:45.914894 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2cd090-6c5d-4b15-a582-e6bc7e2e9493 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.015998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1299/2584] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:45 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:46.020122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcdf1-94a8-4e25-bb47-7472ff54295f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.031132 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebcdf1-94a8-4e25-bb47-7472ff54295f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.035810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba0e55-673b-4450-b14f-0a1a4acfd71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.036411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba0e55-673b-4450-b14f-0a1a4acfd71c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.036693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba0e55-673b-4450-b14f-0a1a4acfd71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.036969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba0e55-673b-4450-b14f-0a1a4acfd71c admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.037634 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba0e55-673b-4450-b14f-0a1a4acfd71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.039223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba0e55-673b-4450-b14f-0a1a4acfd71c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.059127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1286/2585] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:46.061969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd090-6c5d-4b15-a582-e6bc7e2e9493 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.072383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2cd090-6c5d-4b15-a582-e6bc7e2e9493 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.077711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f7f56-d55e-4ef1-a825-6938b6ef2436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.078317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7f56-d55e-4ef1-a825-6938b6ef2436 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.078595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7f56-d55e-4ef1-a825-6938b6ef2436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.078868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f7f56-d55e-4ef1-a825-6938b6ef2436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.079509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f7f56-d55e-4ef1-a825-6938b6ef2436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.081173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f7f56-d55e-4ef1-a825-6938b6ef2436 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.091819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1300/2586] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:46.096663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba0e55-673b-4450-b14f-0a1a4acfd71c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.107582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba0e55-673b-4450-b14f-0a1a4acfd71c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.112819 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ed487-87f7-4fad-b2d7-3b18b9b2b0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.113468 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed487-87f7-4fad-b2d7-3b18b9b2b0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.113781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed487-87f7-4fad-b2d7-3b18b9b2b0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.114059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed487-87f7-4fad-b2d7-3b18b9b2b0fd admin admin] PATH_INFO: `/v3/projects/ecab360c4855492798aa0ff58502b71a/users/174afa6bc01f44f9868778930e077331/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.129845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ed487-87f7-4fad-b2d7-3b18b9b2b0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecab360c4855492798aa0ff58502b71a, user_id=174afa6bc01f44f9868778930e077331, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.132473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ed487-87f7-4fad-b2d7-3b18b9b2b0fd admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.237062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1287/2587] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:46 2022] PUT /identity/v3/projects/ecab360c4855492798aa0ff58502b71a/users/174afa6bc01f44f9868778930e077331/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:46.251397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e31c-d470-459a-b441-e53434901117 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.251742 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e31c-d470-459a-b441-e53434901117 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.252017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e31c-d470-459a-b441-e53434901117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.280548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-6df7e31c-d470-459a-b441-e53434901117 None None] MFA Rules not processed for user `174afa6bc01f44f9868778930e077331`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:46.281795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6df7e31c-d470-459a-b441-e53434901117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:46.345790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1301/2588] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:46.350519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ed487-87f7-4fad-b2d7-3b18b9b2b0fd admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.396320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:46.413032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ed487-87f7-4fad-b2d7-3b18b9b2b0fd admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.417775 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf0020-ac8c-4a1c-acb0-2627dd90fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.418377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf0020-ac8c-4a1c-acb0-2627dd90fc8b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.418659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf0020-ac8c-4a1c-acb0-2627dd90fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.418933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf0020-ac8c-4a1c-acb0-2627dd90fc8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.419552 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf0020-ac8c-4a1c-acb0-2627dd90fc8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.422022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf0020-ac8c-4a1c-acb0-2627dd90fc8b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.536108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1288/2589] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:46 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:46.540241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e31c-d470-459a-b441-e53434901117 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.551159 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e31c-d470-459a-b441-e53434901117 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.577911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:46.607681 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecf763-df98-4c8a-9ab8-68237e159d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.608289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf763-df98-4c8a-9ab8-68237e159d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.608576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf763-df98-4c8a-9ab8-68237e159d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.608859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecf763-df98-4c8a-9ab8-68237e159d63 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.609508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecf763-df98-4c8a-9ab8-68237e159d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.611481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecf763-df98-4c8a-9ab8-68237e159d63 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.695091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1302/2590] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:46 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:46.699247 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf0020-ac8c-4a1c-acb0-2627dd90fc8b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.710137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf0020-ac8c-4a1c-acb0-2627dd90fc8b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.715365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000938d-2aeb-4ed2-a96c-8d55cedf38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.716052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000938d-2aeb-4ed2-a96c-8d55cedf38b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.716409 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000938d-2aeb-4ed2-a96c-8d55cedf38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.716865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000938d-2aeb-4ed2-a96c-8d55cedf38b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.717732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000938d-2aeb-4ed2-a96c-8d55cedf38b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.719422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000938d-2aeb-4ed2-a96c-8d55cedf38b6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.729774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1289/2591] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:46.734316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecf763-df98-4c8a-9ab8-68237e159d63 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.744411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecf763-df98-4c8a-9ab8-68237e159d63 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.749697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38b7b-ca18-4dfe-84d7-f9f73acf4cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.750234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38b7b-ca18-4dfe-84d7-f9f73acf4cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.750515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38b7b-ca18-4dfe-84d7-f9f73acf4cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.750792 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38b7b-ca18-4dfe-84d7-f9f73acf4cbc admin admin] PATH_INFO: `/v3/projects/fed8d94a78804cc7b777eab8658114fa/users/fef92533499d43e387deef0d0320ed8c/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.768517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38b7b-ca18-4dfe-84d7-f9f73acf4cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed8d94a78804cc7b777eab8658114fa, user_id=fef92533499d43e387deef0d0320ed8c, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.771219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38b7b-ca18-4dfe-84d7-f9f73acf4cbc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.843393 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1303/2592] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:46 2022] PUT /identity/v3/projects/fed8d94a78804cc7b777eab8658114fa/users/fef92533499d43e387deef0d0320ed8c/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:46.847538 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000938d-2aeb-4ed2-a96c-8d55cedf38b6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.857424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000938d-2aeb-4ed2-a96c-8d55cedf38b6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.920544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23190955-07db-4895-819e-f58a0c3bea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.923284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190955-07db-4895-819e-f58a0c3bea2c admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.923284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190955-07db-4895-819e-f58a0c3bea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.923284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23190955-07db-4895-819e-f58a0c3bea2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.923284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23190955-07db-4895-819e-f58a0c3bea2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.923941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23190955-07db-4895-819e-f58a0c3bea2c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.933658 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1290/2593] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:41:46.938599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38b7b-ca18-4dfe-84d7-f9f73acf4cbc admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:46.948930 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38b7b-ca18-4dfe-84d7-f9f73acf4cbc admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:46.953537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:46.954252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.954540 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.954816 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] PATH_INFO: `/v3/projects/fed8d94a78804cc7b777eab8658114fa/users/fef92533499d43e387deef0d0320ed8c/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:46.956739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed8d94a78804cc7b777eab8658114fa, user_id=fef92533499d43e387deef0d0320ed8c, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:46.959421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:46.969882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1304/2594] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:46 2022] PUT /identity/v3/projects/fed8d94a78804cc7b777eab8658114fa/users/fef92533499d43e387deef0d0320ed8c/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:46.980022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b2d2f-23c7-4c63-b7de-7fad706e5a1c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:46.980316 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b2d2f-23c7-4c63-b7de-7fad706e5a1c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:46.980627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b2d2f-23c7-4c63-b7de-7fad706e5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:47.008608 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-628b2d2f-23c7-4c63-b7de-7fad706e5a1c None None] MFA Rules not processed for user `fef92533499d43e387deef0d0320ed8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:47.009849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-628b2d2f-23c7-4c63-b7de-7fad706e5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:47.083713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1291/2595] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:41:47.095003 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:47.096717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:47.161515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23279310-c7a5-4127-9dc3-345da07f0b04 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:47.166574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:47.166574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:47.166574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:47.166574 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:47.234989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:47.236488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:47.245781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1305/2596] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:49.293880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b2d2f-23c7-4c63-b7de-7fad706e5a1c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:49.295932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-628b2d2f-23c7-4c63-b7de-7fad706e5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:49.307616 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b2d2f-23c7-4c63-b7de-7fad706e5a1c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:49.311680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a922-71ea-45a9-b8dc-5ec29e98d614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:49.312276 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a922-71ea-45a9-b8dc-5ec29e98d614 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:49.312560 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a922-71ea-45a9-b8dc-5ec29e98d614 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:49.312853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a922-71ea-45a9-b8dc-5ec29e98d614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:49.347943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:49.371286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733a922-71ea-45a9-b8dc-5ec29e98d614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:49.372744 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733a922-71ea-45a9-b8dc-5ec29e98d614 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:49.382249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1292/2597] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:50.200814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:50.202943 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:50.269560 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:50.288997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa339f-6ddf-4b78-9503-8018e1eae2d9 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:50.292958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:50.297818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:50.297818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:50.297818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:50.297818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:50.360508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:50.362053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:50.371616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1306/2598] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:51.107175 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a922-71ea-45a9-b8dc-5ec29e98d614 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:51.120989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a922-71ea-45a9-b8dc-5ec29e98d614 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:51.126110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0fe22-bd54-4f0a-b507-b05c29573984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:51.126812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0fe22-bd54-4f0a-b507-b05c29573984 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:51.127156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0fe22-bd54-4f0a-b507-b05c29573984 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:51.127492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0fe22-bd54-4f0a-b507-b05c29573984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:51.137871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0fe22-bd54-4f0a-b507-b05c29573984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:51.139425 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0fe22-bd54-4f0a-b507-b05c29573984 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:51.151602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1293/2599] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:41:55.078165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:55.080127 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:55.095347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f9f82-d6ba-4ef7-80d4-9d2896512da1 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:55.107913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:55.108572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:55.108855 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:55.109129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] PATH_INFO: `/v3/users/21f47cbaa3084658a6b60da569419ba6` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:55.111490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f47cbaa3084658a6b60da569419ba6)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:55.113503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:55.366980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f47cbaa3084658a6b60da569419ba6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:55.367677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f47cbaa3084658a6b60da569419ba6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:55.368417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f47cbaa3084658a6b60da569419ba6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:55.438714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f47cbaa3084658a6b60da569419ba6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:55.453851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-2890f0fb-e421-495b-8f3d-e78890e1c94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f47cbaa3084658a6b60da569419ba6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:55.472527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1307/2600] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:55 2022] DELETE /identity/v3/users/21f47cbaa3084658a6b60da569419ba6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:55.730891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0fe22-bd54-4f0a-b507-b05c29573984 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:55.740785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0fe22-bd54-4f0a-b507-b05c29573984 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:55.830974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:55.832232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:55.832232 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:55.832441 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] PATH_INFO: `/v3/projects/0af5633a65d5414381be16b53b74ce09` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:55.833578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af5633a65d5414381be16b53b74ce09)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:55.835541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:55.947622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af5633a65d5414381be16b53b74ce09', 'request_id': 'req-cc9cc17c-55db-4850-97dc-2bba6aab7604'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.050149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af5633a65d5414381be16b53b74ce09', 'request_id': 'req-cc9cc17c-55db-4850-97dc-2bba6aab7604'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.071201 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af5633a65d5414381be16b53b74ce09', 'request_id': 'req-cc9cc17c-55db-4850-97dc-2bba6aab7604'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.089853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] The token cache is being invalidate because project 0af5633a65d5414381be16b53b74ce09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:56.090134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.090802 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.092393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1294/2601] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:55 2022] DELETE /identity/v3/projects/0af5633a65d5414381be16b53b74ce09 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:56.097381 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d617b-ba1f-4f4c-85fd-a80bee7ed55c None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.097930 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d617b-ba1f-4f4c-85fd-a80bee7ed55c None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.098568 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d617b-ba1f-4f4c-85fd-a80bee7ed55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.126852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-b12d617b-ba1f-4f4c-85fd-a80bee7ed55c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:56.126852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b12d617b-ba1f-4f4c-85fd-a80bee7ed55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:56.143546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:56.145097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:56.186274 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:56.201776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1308/2602] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:56.207885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca508-66b0-4bcf-aa4d-1aa10502b667 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.208179 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca508-66b0-4bcf-aa4d-1aa10502b667 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.208457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ca508-66b0-4bcf-aa4d-1aa10502b667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.213086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:56.225469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cc17c-55db-4850-97dc-2bba6aab7604 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:56.233214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:56.233214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.233448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-9a4ca508-66b0-4bcf-aa4d-1aa10502b667 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:56.233535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.233535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] PATH_INFO: `/v3/users/48f024c7f4e0446aa3fe38a3db44d8da` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.233743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9a4ca508-66b0-4bcf-aa4d-1aa10502b667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:56.233836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f024c7f4e0446aa3fe38a3db44d8da)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:56.235171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:56.241696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1309/2603] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:56.248883 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ca508-66b0-4bcf-aa4d-1aa10502b667 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:56.258577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ca508-66b0-4bcf-aa4d-1aa10502b667 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:56.264289 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:56.264896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.265173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.265442 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.266147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:41:56.266446 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:56.268053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:56.281113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1310/2604] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:41:56.285316 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:56.300055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025800a5-bd6f-4a1f-8b90-35f01a4e0fb6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:56.305004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a0a8-45f9-4cee-9625-91fddb3f2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:56.305665 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a0a8-45f9-4cee-9625-91fddb3f2e74 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.305946 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a0a8-45f9-4cee-9625-91fddb3f2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.306219 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a0a8-45f9-4cee-9625-91fddb3f2e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.306869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67a0a8-45f9-4cee-9625-91fddb3f2e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:56.308793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67a0a8-45f9-4cee-9625-91fddb3f2e74 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:56.400209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1311/2605] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:56 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:56.404888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a0a8-45f9-4cee-9625-91fddb3f2e74 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:56.468672 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a0a8-45f9-4cee-9625-91fddb3f2e74 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:56.474356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01f5c4-9ec0-4335-b8e4-9f6f21c8fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:56.475057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f5c4-9ec0-4335-b8e4-9f6f21c8fabc admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.475383 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f5c4-9ec0-4335-b8e4-9f6f21c8fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.475550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f5c4-9ec0-4335-b8e4-9f6f21c8fabc admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.476182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01f5c4-9ec0-4335-b8e4-9f6f21c8fabc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:56.478199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01f5c4-9ec0-4335-b8e4-9f6f21c8fabc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:56.481980 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f024c7f4e0446aa3fe38a3db44d8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.488916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f024c7f4e0446aa3fe38a3db44d8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.489596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f024c7f4e0446aa3fe38a3db44d8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.490325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f024c7f4e0446aa3fe38a3db44d8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.502888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f024c7f4e0446aa3fe38a3db44d8da'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:56.594506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1295/2606] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:56 2022] DELETE /identity/v3/users/48f024c7f4e0446aa3fe38a3db44d8da => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:56.596641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1312/2607] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:56 2022] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:41:56.598944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:56.599415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4f2f7-4bde-451e-8c0f-403cdff23e96 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.599759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4f2f7-4bde-451e-8c0f-403cdff23e96 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.600068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4f2f7-4bde-451e-8c0f-403cdff23e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.601695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:56.625814 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-3be4f2f7-4bde-451e-8c0f-403cdff23e96 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:56.628703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3be4f2f7-4bde-451e-8c0f-403cdff23e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:56.713739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040f48-d83e-4929-96e6-14f56fae90f9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:56.717345 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1313/2608] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:56.719503 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dee739-9df5-43ec-819c-417f6b689e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:56.720377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dee739-9df5-43ec-819c-417f6b689e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.720909 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dee739-9df5-43ec-819c-417f6b689e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.721506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dee739-9df5-43ec-819c-417f6b689e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.722479 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dee739-9df5-43ec-819c-417f6b689e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:56.724271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dee739-9df5-43ec-819c-417f6b689e35 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:56.729417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4f2f7-4bde-451e-8c0f-403cdff23e96 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:56.730959 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-3be4f2f7-4bde-451e-8c0f-403cdff23e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:56.736438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1296/2609] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:56.740462 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dee739-9df5-43ec-819c-417f6b689e35 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:56.750736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dee739-9df5-43ec-819c-417f6b689e35 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:56.755836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a684f-89d6-4440-a42d-47e1d53037fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:56.756452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a684f-89d6-4440-a42d-47e1d53037fa admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.756734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a684f-89d6-4440-a42d-47e1d53037fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.757006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a684f-89d6-4440-a42d-47e1d53037fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.757697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a684f-89d6-4440-a42d-47e1d53037fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:56.759667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a684f-89d6-4440-a42d-47e1d53037fa admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:56.776154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1297/2610] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:56.780606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a684f-89d6-4440-a42d-47e1d53037fa admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:56.785882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:56.791308 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4f2f7-4bde-451e-8c0f-403cdff23e96 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:56.794992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a684f-89d6-4440-a42d-47e1d53037fa admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:56.795581 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef31948-9545-4ecf-a7fa-83eb4753107f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:56.796194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31948-9545-4ecf-a7fa-83eb4753107f service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.796477 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31948-9545-4ecf-a7fa-83eb4753107f service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.796752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef31948-9545-4ecf-a7fa-83eb4753107f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.796981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841bec8-06ee-4524-9a4c-29f88b846b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:56.797656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841bec8-06ee-4524-9a4c-29f88b846b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.797941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841bec8-06ee-4524-9a4c-29f88b846b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.798214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841bec8-06ee-4524-9a4c-29f88b846b61 admin admin] PATH_INFO: `/v3/projects/0d59f028de7a425c916173c9210dd88c/users/5ace2ad961924c37acba491fc315155c/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.806033 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef31948-9545-4ecf-a7fa-83eb4753107f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:56.807778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef31948-9545-4ecf-a7fa-83eb4753107f service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:56.816551 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841bec8-06ee-4524-9a4c-29f88b846b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d59f028de7a425c916173c9210dd88c, user_id=5ace2ad961924c37acba491fc315155c, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:56.819480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4841bec8-06ee-4524-9a4c-29f88b846b61 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:56.820256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1314/2611] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:41:56.945693 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1298/2612] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:56 2022] PUT /identity/v3/projects/0d59f028de7a425c916173c9210dd88c/users/5ace2ad961924c37acba491fc315155c/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:56.958780 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1c39-bd7a-4040-9cb2-b77ac44875de None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:56.959079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1c39-bd7a-4040-9cb2-b77ac44875de None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:56.959362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd1c39-bd7a-4040-9cb2-b77ac44875de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:56.987796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-adbd1c39-bd7a-4040-9cb2-b77ac44875de None None] MFA Rules not processed for user `5ace2ad961924c37acba491fc315155c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:56.989085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-adbd1c39-bd7a-4040-9cb2-b77ac44875de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:57.067534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1315/2613] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:57.078526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841bec8-06ee-4524-9a4c-29f88b846b61 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.117199 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:57.145493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841bec8-06ee-4524-9a4c-29f88b846b61 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:57.150243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:57.150860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.151123 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.151392 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.152016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:57.154456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:57.270959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1299/2614] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:41:57 2022] POST /identity/v3/projects => generated 403 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:57.273432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd1c39-bd7a-4040-9cb2-b77ac44875de None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.284279 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd1c39-bd7a-4040-9cb2-b77ac44875de None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:57.298952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.301176 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:57.357662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c41c6-1cee-47cb-826c-19d9ceb5e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:57.359036 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c41c6-1cee-47cb-826c-19d9ceb5e808 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.359454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c41c6-1cee-47cb-826c-19d9ceb5e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.359744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c41c6-1cee-47cb-826c-19d9ceb5e808 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.360431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c41c6-1cee-47cb-826c-19d9ceb5e808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:57.362421 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c41c6-1cee-47cb-826c-19d9ceb5e808 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:57.389605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733a01b-87d6-4ce6-b442-3bde19abeb23 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:57.394300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:57.394939 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.395255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.395501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] PATH_INFO: `/v3/projects/08cc808608e746c3ad86167c556e28d1` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.396632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=08cc808608e746c3ad86167c556e28d1)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:57.398591 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:57.477150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1316/2615] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:41:57 2022] POST /identity/v3/users => generated 308 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:41:57.481130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c41c6-1cee-47cb-826c-19d9ceb5e808 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.491798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c41c6-1cee-47cb-826c-19d9ceb5e808 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:57.496535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457842-2fc6-420b-8540-14bb2184ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:57.497142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457842-2fc6-420b-8540-14bb2184ce24 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.497417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457842-2fc6-420b-8540-14bb2184ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.498311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457842-2fc6-420b-8540-14bb2184ce24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.498958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457842-2fc6-420b-8540-14bb2184ce24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:57.500563 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457842-2fc6-420b-8540-14bb2184ce24 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:57.510496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1317/2616] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:57.515066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457842-2fc6-420b-8540-14bb2184ce24 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.525022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457842-2fc6-420b-8540-14bb2184ce24 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:57.536609 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08cc808608e746c3ad86167c556e28d1', 'request_id': 'req-dd1f0c27-1cad-4289-9346-1721d31063fd'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.580715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:57.586668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:57.587338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.587622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.587900 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] PATH_INFO: `/v3/projects/fa5d6d8388a3412f97efa76c1a83e7f2/users/668f2f6624a04068a0bb18fe761b63ff/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.602406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5d6d8388a3412f97efa76c1a83e7f2, user_id=668f2f6624a04068a0bb18fe761b63ff, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:57.605065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:57.637047 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08cc808608e746c3ad86167c556e28d1', 'request_id': 'req-dd1f0c27-1cad-4289-9346-1721d31063fd'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.643902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08cc808608e746c3ad86167c556e28d1', 'request_id': 'req-dd1f0c27-1cad-4289-9346-1721d31063fd'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.655897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] The token cache is being invalidate because project 08cc808608e746c3ad86167c556e28d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:57.655897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.656165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.657491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1300/2617] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:57 2022] DELETE /identity/v3/projects/08cc808608e746c3ad86167c556e28d1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:57.661566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.664215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:57.680069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1318/2618] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:57 2022] PUT /identity/v3/projects/fa5d6d8388a3412f97efa76c1a83e7f2/users/668f2f6624a04068a0bb18fe761b63ff/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:57.682937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f0c27-1cad-4289-9346-1721d31063fd admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:57.683953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.686507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:57.739385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:57.752696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:57.753382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.753565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.753942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] PATH_INFO: `/v3/users/174afa6bc01f44f9868778930e077331` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.755028 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=174afa6bc01f44f9868778930e077331)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:57.756940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:57.762712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bc5bf-f594-4a13-9ec5-57556db66655 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:57.767664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23adda6-d6ae-40fd-95b3-e7e2605e4f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:57.768346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23adda6-d6ae-40fd-95b3-e7e2605e4f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.768691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23adda6-d6ae-40fd-95b3-e7e2605e4f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.769016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23adda6-d6ae-40fd-95b3-e7e2605e4f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.769736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23adda6-d6ae-40fd-95b3-e7e2605e4f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:57.771438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23adda6-d6ae-40fd-95b3-e7e2605e4f9e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:57.781908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1319/2619] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:41:57.786011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23adda6-d6ae-40fd-95b3-e7e2605e4f9e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.796165 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23adda6-d6ae-40fd-95b3-e7e2605e4f9e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:57.801821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09768428-9a33-46d0-83be-c8f577126679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:57.802906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768428-9a33-46d0-83be-c8f577126679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.803264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768428-9a33-46d0-83be-c8f577126679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.803667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768428-9a33-46d0-83be-c8f577126679 admin admin] PATH_INFO: `/v3/projects/fa5d6d8388a3412f97efa76c1a83e7f2/users/668f2f6624a04068a0bb18fe761b63ff/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.806100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09768428-9a33-46d0-83be-c8f577126679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5d6d8388a3412f97efa76c1a83e7f2, user_id=668f2f6624a04068a0bb18fe761b63ff, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:57.808777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09768428-9a33-46d0-83be-c8f577126679 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:57.820130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1320/2620] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:41:57 2022] PUT /identity/v3/projects/fa5d6d8388a3412f97efa76c1a83e7f2/users/668f2f6624a04068a0bb18fe761b63ff/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:57.831366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982f6d-36d5-426d-acbb-0b3630e90915 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:57.831713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982f6d-36d5-426d-acbb-0b3630e90915 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:57.831881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982f6d-36d5-426d-acbb-0b3630e90915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:57.863790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-af982f6d-36d5-426d-acbb-0b3630e90915 None None] MFA Rules not processed for user `668f2f6624a04068a0bb18fe761b63ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:57.865037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-af982f6d-36d5-426d-acbb-0b3630e90915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:57.934244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174afa6bc01f44f9868778930e077331'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.939896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1321/2621] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:57.946809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174afa6bc01f44f9868778930e077331'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.947630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174afa6bc01f44f9868778930e077331'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.948313 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174afa6bc01f44f9868778930e077331'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:57.949736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af982f6d-36d5-426d-acbb-0b3630e90915 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:57.951151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-af982f6d-36d5-426d-acbb-0b3630e90915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:57.960574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174afa6bc01f44f9868778930e077331'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.017011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:58.020916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af982f6d-36d5-426d-acbb-0b3630e90915 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:58.033398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:58.033398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:58.033398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:58.033398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:58.037399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:58.045489 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1301/2622] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:57 2022] DELETE /identity/v3/users/174afa6bc01f44f9868778930e077331 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:58.054131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:58.055928 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:58.081847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1322/2623] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:57 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:41:58.234460 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:58.235931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:58.322331 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3899a9-4a3f-44b6-9c37-da4866e80687 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:58.328746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:58.329817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:58.330292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:58.330860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] PATH_INFO: `/v3/users/5ace2ad961924c37acba491fc315155c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:58.332615 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ace2ad961924c37acba491fc315155c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:58.334521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:58.533977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:58.536053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:58.542568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ace2ad961924c37acba491fc315155c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.550646 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ace2ad961924c37acba491fc315155c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.552582 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ace2ad961924c37acba491fc315155c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.553186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ace2ad961924c37acba491fc315155c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.566506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:58.568799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-b9aab9c2-e057-4b67-9e08-e791712131c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ace2ad961924c37acba491fc315155c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.618092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41845-5b0f-4b24-9006-cb498e5138c3 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:58.623113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:58.623751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:58.624052 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:58.624320 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] PATH_INFO: `/v3/projects/ecab360c4855492798aa0ff58502b71a` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:58.625448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecab360c4855492798aa0ff58502b71a)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:58.627389 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:58.649266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1302/2624] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:58 2022] DELETE /identity/v3/users/5ace2ad961924c37acba491fc315155c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:58.654082 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69488ab4-6861-4d10-9e83-71938902143d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:58.654401 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69488ab4-6861-4d10-9e83-71938902143d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:58.654680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69488ab4-6861-4d10-9e83-71938902143d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:58.676122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-69488ab4-6861-4d10-9e83-71938902143d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:41:58.677366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-69488ab4-6861-4d10-9e83-71938902143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:58.740188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1303/2625] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:41:58.750544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69488ab4-6861-4d10-9e83-71938902143d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:58.759374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-69488ab4-6861-4d10-9e83-71938902143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:58.785147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecab360c4855492798aa0ff58502b71a', 'request_id': 'req-e121e7f5-55fb-499d-9bd6-c12179bed3c1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.791740 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecab360c4855492798aa0ff58502b71a', 'request_id': 'req-e121e7f5-55fb-499d-9bd6-c12179bed3c1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.814432 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69488ab4-6861-4d10-9e83-71938902143d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:58.863592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:58.864206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:58.864491 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:58.864768 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:58.889043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecab360c4855492798aa0ff58502b71a', 'request_id': 'req-e121e7f5-55fb-499d-9bd6-c12179bed3c1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.896597 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] The token cache is being invalidate because project ecab360c4855492798aa0ff58502b71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:58.896893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.897539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:58.899069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1323/2626] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:58 2022] DELETE /identity/v3/projects/ecab360c4855492798aa0ff58502b71a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:58.903184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:58.904858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:58.924920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:58.929133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:58.930643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:58.942223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1304/2627] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:41:58.981087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121e7f5-55fb-499d-9bd6-c12179bed3c1 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:58.987371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:58.988285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:58.988780 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:58.989284 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] PATH_INFO: `/v3/users/fef92533499d43e387deef0d0320ed8c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:58.990882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef92533499d43e387deef0d0320ed8c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:58.993472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:59.022090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:59.149880 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef92533499d43e387deef0d0320ed8c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.150485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef92533499d43e387deef0d0320ed8c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.151143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef92533499d43e387deef0d0320ed8c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.238504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef92533499d43e387deef0d0320ed8c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.252419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef92533499d43e387deef0d0320ed8c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.271258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1324/2628] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:58 2022] DELETE /identity/v3/users/fef92533499d43e387deef0d0320ed8c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:41:59.343983 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:59.345701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:59.364246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e26bb-8b31-4e2f-932b-e9559a20cd23 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:59.444796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:59.445439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:59.445783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:59.446160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] PATH_INFO: `/v3/projects/0d59f028de7a425c916173c9210dd88c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:59.447519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d59f028de7a425c916173c9210dd88c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:59.451364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:59.507609 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:59.509229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:59.575080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc3394-edce-44cb-a184-474118e4a98c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:59.588801 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d59f028de7a425c916173c9210dd88c', 'request_id': 'req-f3667f3f-93e0-4814-8115-062bd2810850'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.630218 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:59.630841 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:59.631120 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:59.633673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:59.633673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:59.655640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d59f028de7a425c916173c9210dd88c', 'request_id': 'req-f3667f3f-93e0-4814-8115-062bd2810850'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.663305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d59f028de7a425c916173c9210dd88c', 'request_id': 'req-f3667f3f-93e0-4814-8115-062bd2810850'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.678612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] The token cache is being invalidate because project 0d59f028de7a425c916173c9210dd88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:41:59.678822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.679407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.680948 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1305/2629] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:59 2022] DELETE /identity/v3/projects/0d59f028de7a425c916173c9210dd88c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:41:59.685040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:59.686777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:59.712480 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:59.714001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:59.724934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1325/2630] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:41:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:41:59.757737 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667f3f-93e0-4814-8115-062bd2810850 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:59.763500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:59.764225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:59.764580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:59.764928 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] PATH_INFO: `/v3/users/668f2f6624a04068a0bb18fe761b63ff` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:59.766207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] RBAC: Authorizing `identity:delete_user(user_id=668f2f6624a04068a0bb18fe761b63ff)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:59.768194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:59.779522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:41:59.780958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:41:59.794890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ec6bc-d081-43b6-b6d6-bc40adba9f6b service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:41:59.801830 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:41:59.802534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:41:59.802827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:41:59.803106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] PATH_INFO: `/v3/projects/fed8d94a78804cc7b777eab8658114fa` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:41:59.804447 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed8d94a78804cc7b777eab8658114fa)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:41:59.807228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:41:59.809147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:59.873700 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:59.967985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668f2f6624a04068a0bb18fe761b63ff'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.969175 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed8d94a78804cc7b777eab8658114fa', 'request_id': 'req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.975696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668f2f6624a04068a0bb18fe761b63ff'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.976431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668f2f6624a04068a0bb18fe761b63ff'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.977069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668f2f6624a04068a0bb18fe761b63ff'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.977278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed8d94a78804cc7b777eab8658114fa', 'request_id': 'req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:41:59.994606 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-03ee486a-eed6-43e9-a701-485a815f021b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668f2f6624a04068a0bb18fe761b63ff'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:00.065287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed8d94a78804cc7b777eab8658114fa', 'request_id': 'req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:00.077062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] The token cache is being invalidate because project fed8d94a78804cc7b777eab8658114fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:00.077576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:00.079182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-334d4fd5-5cdd-4884-9e8b-be3d5a990bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:00.080688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1326/2631] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:41:59 2022] DELETE /identity/v3/projects/fed8d94a78804cc7b777eab8658114fa => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:00.087027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b0d7-7017-4dbf-baaf-6c0d767b1272 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.087934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b0d7-7017-4dbf-baaf-6c0d767b1272 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.088575 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b0d7-7017-4dbf-baaf-6c0d767b1272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.111650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-5b87b0d7-7017-4dbf-baaf-6c0d767b1272 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:00.112863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5b87b0d7-7017-4dbf-baaf-6c0d767b1272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:00.133300 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1306/2632] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:41:59 2022] DELETE /identity/v3/users/668f2f6624a04068a0bb18fe761b63ff => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:00.191627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1327/2633] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:00.199920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede75c-aa7b-4c40-8b6c-fad7fbdf13a8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.200210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede75c-aa7b-4c40-8b6c-fad7fbdf13a8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.200516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede75c-aa7b-4c40-8b6c-fad7fbdf13a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.226621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bdede75c-aa7b-4c40-8b6c-fad7fbdf13a8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:00.226621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bdede75c-aa7b-4c40-8b6c-fad7fbdf13a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:00.293668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1307/2634] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:00.297147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87b0d7-7017-4dbf-baaf-6c0d767b1272 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:00.307497 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87b0d7-7017-4dbf-baaf-6c0d767b1272 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:00.312399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:00.313010 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.313296 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.313570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.314249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:00.314553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:00.316503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:00.337012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1328/2635] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:00.342555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdede75c-aa7b-4c40-8b6c-fad7fbdf13a8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:00.353375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdede75c-aa7b-4c40-8b6c-fad7fbdf13a8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:00.358584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b4ef-947d-426e-b9d9-4a92a60a0b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:00.359516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b4ef-947d-426e-b9d9-4a92a60a0b47 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.359681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b4ef-947d-426e-b9d9-4a92a60a0b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.360096 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b4ef-947d-426e-b9d9-4a92a60a0b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.360799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b4ef-947d-426e-b9d9-4a92a60a0b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:00.363036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b4ef-947d-426e-b9d9-4a92a60a0b47 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:00.490041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1308/2636] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:00 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:00.494482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:00.505349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5267c6f-db62-4a92-8f98-7f561cb91fb7 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:00.575252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f666-c697-450a-a8d9-8c3e35776859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:00.575906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f666-c697-450a-a8d9-8c3e35776859 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.576124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f666-c697-450a-a8d9-8c3e35776859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.576397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f666-c697-450a-a8d9-8c3e35776859 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.577063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f666-c697-450a-a8d9-8c3e35776859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:00.579142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f666-c697-450a-a8d9-8c3e35776859 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:00.687832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1329/2637] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:00 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:00.689166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b4ef-947d-426e-b9d9-4a92a60a0b47 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:00.702753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b4ef-947d-426e-b9d9-4a92a60a0b47 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:00.707540 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9d640-7b08-4a48-89c4-1441119f7d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:00.708231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9d640-7b08-4a48-89c4-1441119f7d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.708822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9d640-7b08-4a48-89c4-1441119f7d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.709023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9d640-7b08-4a48-89c4-1441119f7d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.709702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9d640-7b08-4a48-89c4-1441119f7d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:00.711298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9d640-7b08-4a48-89c4-1441119f7d09 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:00.721796 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1309/2638] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:00.725922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f666-c697-450a-a8d9-8c3e35776859 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:00.736764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f666-c697-450a-a8d9-8c3e35776859 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:00.741436 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:00.742007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.742293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.742570 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.743211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:00.744830 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:00.746172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:00.756687 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1330/2639] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:00.760743 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9d640-7b08-4a48-89c4-1441119f7d09 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:00.769191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:00.771486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:00.771823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9d640-7b08-4a48-89c4-1441119f7d09 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:00.777043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c7122-9c0e-42e4-8d67-2104a6eccc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:00.777836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c7122-9c0e-42e4-8d67-2104a6eccc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.778118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c7122-9c0e-42e4-8d67-2104a6eccc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.778390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c7122-9c0e-42e4-8d67-2104a6eccc86 admin admin] PATH_INFO: `/v3/projects/bf1ec79a765c450e9570998566a8c43e/users/ade4a956715a4403a9369f8c9d3c9e1d/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.787136 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606398cb-564d-45f3-a00e-626071a23103 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:00.792763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:00.794743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.794743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.794960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] PATH_INFO: `/v3/projects/fa5d6d8388a3412f97efa76c1a83e7f2` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:00.795974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5d6d8388a3412f97efa76c1a83e7f2)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:00.796389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c7122-9c0e-42e4-8d67-2104a6eccc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1ec79a765c450e9570998566a8c43e, user_id=ade4a956715a4403a9369f8c9d3c9e1d, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:00.797968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:00.799062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c7122-9c0e-42e4-8d67-2104a6eccc86 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:00.921890 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1310/2640] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:00 2022] PUT /identity/v3/projects/bf1ec79a765c450e9570998566a8c43e/users/ade4a956715a4403a9369f8c9d3c9e1d/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:00.925896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5d6d8388a3412f97efa76c1a83e7f2', 'request_id': 'req-7e0d7a54-a917-4598-8e14-b61775484c26'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:00.932901 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5d6d8388a3412f97efa76c1a83e7f2', 'request_id': 'req-7e0d7a54-a917-4598-8e14-b61775484c26'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:00.994812 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24b57-162f-4b38-a7d9-f97fb6f24284 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:00.995148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24b57-162f-4b38-a7d9-f97fb6f24284 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:00.995492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24b57-162f-4b38-a7d9-f97fb6f24284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.027195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-0ff24b57-162f-4b38-a7d9-f97fb6f24284 None None] MFA Rules not processed for user `ade4a956715a4403a9369f8c9d3c9e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:01.028759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0ff24b57-162f-4b38-a7d9-f97fb6f24284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:01.032507 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5d6d8388a3412f97efa76c1a83e7f2', 'request_id': 'req-7e0d7a54-a917-4598-8e14-b61775484c26'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:01.048653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] The token cache is being invalidate because project fa5d6d8388a3412f97efa76c1a83e7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:01.049187 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:01.050382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-7e0d7a54-a917-4598-8e14-b61775484c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:01.051770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1331/2641] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:00 2022] DELETE /identity/v3/projects/fa5d6d8388a3412f97efa76c1a83e7f2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:01.069868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20125d0-bc87-464d-8cc2-9a7e63c44885 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.070470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20125d0-bc87-464d-8cc2-9a7e63c44885 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.070991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20125d0-bc87-464d-8cc2-9a7e63c44885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.094529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-c20125d0-bc87-464d-8cc2-9a7e63c44885 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:01.096904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c20125d0-bc87-464d-8cc2-9a7e63c44885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:01.098161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:01.130774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1311/2642] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:01.143929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff24b57-162f-4b38-a7d9-f97fb6f24284 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:01.146059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0ff24b57-162f-4b38-a7d9-f97fb6f24284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:01.172925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1332/2643] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:01.180339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b63c2-2446-4623-88c8-e05e46914d87 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.180638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b63c2-2446-4623-88c8-e05e46914d87 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.180913 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b63c2-2446-4623-88c8-e05e46914d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.201907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-590b63c2-2446-4623-88c8-e05e46914d87 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:01.203398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-590b63c2-2446-4623-88c8-e05e46914d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:01.205989 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff24b57-162f-4b38-a7d9-f97fb6f24284 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:01.209863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8691c-d91d-4392-9d0c-05885e93a752 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8070d1891844da59196d00ebbdff832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:01.210555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8691c-d91d-4392-9d0c-05885e93a752 service glance] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.210910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8691c-d91d-4392-9d0c-05885e93a752 service glance] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.211259 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8691c-d91d-4392-9d0c-05885e93a752 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.211397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1333/2644] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:01.216157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b63c2-2446-4623-88c8-e05e46914d87 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:01.225881 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b63c2-2446-4623-88c8-e05e46914d87 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:01.228051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8691c-d91d-4392-9d0c-05885e93a752 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:01.229847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8691c-d91d-4392-9d0c-05885e93a752 service glance] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:01.230610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:01.231208 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.231493 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.232291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.232935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:01.233236 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:01.235046 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:01.241572 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1312/2645] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:42:01.253326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1334/2646] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:01.254445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8691c-d91d-4392-9d0c-05885e93a752 service glance] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:01.265740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8691c-d91d-4392-9d0c-05885e93a752 service glance] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:01.277910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4716640-5f6b-4161-84cd-ca2673a75dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:01.277910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4716640-5f6b-4161-84cd-ca2673a75dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.277910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4716640-5f6b-4161-84cd-ca2673a75dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.277910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4716640-5f6b-4161-84cd-ca2673a75dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.279320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4716640-5f6b-4161-84cd-ca2673a75dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:01.279320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4716640-5f6b-4161-84cd-ca2673a75dbf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:01.358956 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1313/2647] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:01 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:01.370826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:01.378047 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326155b-1d24-45b5-a401-95214aadfc34 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:01.459427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbde6-d8fc-428d-a8ad-4f0627ff51e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:01.460024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbde6-d8fc-428d-a8ad-4f0627ff51e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.460402 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbde6-d8fc-428d-a8ad-4f0627ff51e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.460743 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dbde6-d8fc-428d-a8ad-4f0627ff51e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.461437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dbde6-d8fc-428d-a8ad-4f0627ff51e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:01.464769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dbde6-d8fc-428d-a8ad-4f0627ff51e1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:01.473472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:01.600132 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1335/2648] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:01 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:01.604198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4716640-5f6b-4161-84cd-ca2673a75dbf admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:01.615986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4716640-5f6b-4161-84cd-ca2673a75dbf admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:01.625511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431dafa-0787-4665-8612-4fc3fb5b03b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:01.626356 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431dafa-0787-4665-8612-4fc3fb5b03b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.626835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431dafa-0787-4665-8612-4fc3fb5b03b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.627390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431dafa-0787-4665-8612-4fc3fb5b03b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.628485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431dafa-0787-4665-8612-4fc3fb5b03b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:01.630480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431dafa-0787-4665-8612-4fc3fb5b03b8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:01.645846 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1314/2649] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:01.650337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbde6-d8fc-428d-a8ad-4f0627ff51e1 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:01.663423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dbde6-d8fc-428d-a8ad-4f0627ff51e1 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:01.668221 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2f631-035a-4a02-bd85-6fec9b8bad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:01.668825 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f631-035a-4a02-bd85-6fec9b8bad8a admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.669789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f631-035a-4a02-bd85-6fec9b8bad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.670067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f631-035a-4a02-bd85-6fec9b8bad8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.670789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2f631-035a-4a02-bd85-6fec9b8bad8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:01.672382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2f631-035a-4a02-bd85-6fec9b8bad8a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:01.684888 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1336/2650] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:01.689293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431dafa-0787-4665-8612-4fc3fb5b03b8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:01.700178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431dafa-0787-4665-8612-4fc3fb5b03b8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:01.705525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb871ae-2393-4c29-9f13-44349e15d359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:01.706556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb871ae-2393-4c29-9f13-44349e15d359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.707079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb871ae-2393-4c29-9f13-44349e15d359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.707823 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb871ae-2393-4c29-9f13-44349e15d359 admin admin] PATH_INFO: `/v3/projects/fa5ae54cdd464fcab51278d0f6f82d30/users/efc1aec9f292459baa4b0116a0635630/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.724095 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb871ae-2393-4c29-9f13-44349e15d359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5ae54cdd464fcab51278d0f6f82d30, user_id=efc1aec9f292459baa4b0116a0635630, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:01.727361 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb871ae-2393-4c29-9f13-44349e15d359 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:01.811970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1315/2651] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:01 2022] PUT /identity/v3/projects/fa5ae54cdd464fcab51278d0f6f82d30/users/efc1aec9f292459baa4b0116a0635630/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:01.824149 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258b086-f60f-46ce-958b-a86e084dfaf8 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:01.824703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258b086-f60f-46ce-958b-a86e084dfaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:01.825281 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258b086-f60f-46ce-958b-a86e084dfaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:01.857857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-5258b086-f60f-46ce-958b-a86e084dfaf8 None None] MFA Rules not processed for user `efc1aec9f292459baa4b0116a0635630`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:01.859099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5258b086-f60f-46ce-958b-a86e084dfaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:01.949509 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1337/2652] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:01.958506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb871ae-2393-4c29-9f13-44349e15d359 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:02.024307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb871ae-2393-4c29-9f13-44349e15d359 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:02.033427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739964d-e220-4250-b3c1-09288362c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:02.034115 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739964d-e220-4250-b3c1-09288362c70f admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:02.034342 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739964d-e220-4250-b3c1-09288362c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:02.034618 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739964d-e220-4250-b3c1-09288362c70f admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:02.035306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739964d-e220-4250-b3c1-09288362c70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:02.037307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739964d-e220-4250-b3c1-09288362c70f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:02.127257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1316/2653] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:01 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:02.131203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258b086-f60f-46ce-958b-a86e084dfaf8 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:02.154309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258b086-f60f-46ce-958b-a86e084dfaf8 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:02.233895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c6b7c-36c3-4dd6-ae04-6d290ecc101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:02.234539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6b7c-36c3-4dd6-ae04-6d290ecc101e admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:02.234886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6b7c-36c3-4dd6-ae04-6d290ecc101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:02.235224 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6b7c-36c3-4dd6-ae04-6d290ecc101e admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:02.236979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c6b7c-36c3-4dd6-ae04-6d290ecc101e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:02.239138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c6b7c-36c3-4dd6-ae04-6d290ecc101e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:02.331650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1338/2654] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:02 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:02.333033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739964d-e220-4250-b3c1-09288362c70f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:02.344094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739964d-e220-4250-b3c1-09288362c70f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:02.348886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3641a8-f820-416b-b163-e3c954d36a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:02.349493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3641a8-f820-416b-b163-e3c954d36a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:02.350100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3641a8-f820-416b-b163-e3c954d36a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:02.350100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3641a8-f820-416b-b163-e3c954d36a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:02.350974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3641a8-f820-416b-b163-e3c954d36a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:02.352457 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3641a8-f820-416b-b163-e3c954d36a30 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:02.354207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:02.366905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1317/2655] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:02.371184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c6b7c-36c3-4dd6-ae04-6d290ecc101e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:02.382467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c6b7c-36c3-4dd6-ae04-6d290ecc101e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:02.387710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9cc6e-58ea-41df-9dde-00d70d6de4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:02.388499 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9cc6e-58ea-41df-9dde-00d70d6de4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:02.388781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9cc6e-58ea-41df-9dde-00d70d6de4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:02.389271 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9cc6e-58ea-41df-9dde-00d70d6de4f0 admin admin] PATH_INFO: `/v3/projects/4f90b7b31c774ee29abf12d008f5318f/users/df53211aaaff47909683690d53161897/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:02.405420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9cc6e-58ea-41df-9dde-00d70d6de4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f90b7b31c774ee29abf12d008f5318f, user_id=df53211aaaff47909683690d53161897, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:02.408361 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9cc6e-58ea-41df-9dde-00d70d6de4f0 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:02.530212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1339/2656] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:02 2022] PUT /identity/v3/projects/4f90b7b31c774ee29abf12d008f5318f/users/df53211aaaff47909683690d53161897/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:02.534226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3641a8-f820-416b-b163-e3c954d36a30 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:02.544283 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3641a8-f820-416b-b163-e3c954d36a30 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:02.601193 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db632db-1ff7-499b-846b-826c3a7820e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:02.601759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db632db-1ff7-499b-846b-826c3a7820e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:02.602043 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db632db-1ff7-499b-846b-826c3a7820e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:02.602314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db632db-1ff7-499b-846b-826c3a7820e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:02.602949 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db632db-1ff7-499b-846b-826c3a7820e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:02.604532 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db632db-1ff7-499b-846b-826c3a7820e2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:02.617797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1318/2657] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:02.623923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9cc6e-58ea-41df-9dde-00d70d6de4f0 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:02.635366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9cc6e-58ea-41df-9dde-00d70d6de4f0 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:02.641454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:02.642682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:02.643247 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:02.646911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] PATH_INFO: `/v3/projects/4f90b7b31c774ee29abf12d008f5318f/users/df53211aaaff47909683690d53161897/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:02.646911 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f90b7b31c774ee29abf12d008f5318f, user_id=df53211aaaff47909683690d53161897, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:02.649428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:02.661712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1340/2658] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:02 2022] PUT /identity/v3/projects/4f90b7b31c774ee29abf12d008f5318f/users/df53211aaaff47909683690d53161897/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:02.672901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6599c-1e18-44d9-9a75-151a63a2cc9b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:02.673196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6599c-1e18-44d9-9a75-151a63a2cc9b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:02.673485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6599c-1e18-44d9-9a75-151a63a2cc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:02.709304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-dbe6599c-1e18-44d9-9a75-151a63a2cc9b None None] MFA Rules not processed for user `df53211aaaff47909683690d53161897`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:02.711086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dbe6599c-1e18-44d9-9a75-151a63a2cc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:02.788892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1319/2659] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:02.801452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:02.803001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:02.854948 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:02.907582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec8c4f-1cb0-49d1-967a-28efba2b5238 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:02.911573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6de6-b3c1-41c2-aaba-29f068e7a7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:02.912198 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6de6-b3c1-41c2-aaba-29f068e7a7df service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:02.912483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6de6-b3c1-41c2-aaba-29f068e7a7df service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:02.912763 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6de6-b3c1-41c2-aaba-29f068e7a7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:02.999237 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6de6-b3c1-41c2-aaba-29f068e7a7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:03.000955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6de6-b3c1-41c2-aaba-29f068e7a7df service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:03.016934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1341/2660] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:03.678528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6599c-1e18-44d9-9a75-151a63a2cc9b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:03.679965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-dbe6599c-1e18-44d9-9a75-151a63a2cc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:03.745322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6599c-1e18-44d9-9a75-151a63a2cc9b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:03.750959 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:03.753450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:03.753450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:03.753450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] PATH_INFO: `/v3/users/7406a426e16a415e9c1f457f58a0871b` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:03.753807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7406a426e16a415e9c1f457f58a0871b)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:03.755713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:03.799307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:04.027992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7406a426e16a415e9c1f457f58a0871b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.035668 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7406a426e16a415e9c1f457f58a0871b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.036354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7406a426e16a415e9c1f457f58a0871b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.036965 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7406a426e16a415e9c1f457f58a0871b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.049257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c22ffb04-50cb-4b82-a3fa-cd886bb7df55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7406a426e16a415e9c1f457f58a0871b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.131298 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1320/2661] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:03 2022] DELETE /identity/v3/users/7406a426e16a415e9c1f457f58a0871b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:04.375839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6de6-b3c1-41c2-aaba-29f068e7a7df service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:04.389039 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6de6-b3c1-41c2-aaba-29f068e7a7df service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:04.446698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:04.447342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:04.447626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:04.447904 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] PATH_INFO: `/v3/projects/24fa4a5370b446f58b2461535f16e9d4` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:04.449125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fa4a5370b446f58b2461535f16e9d4)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:04.451287 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:04.557605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fa4a5370b446f58b2461535f16e9d4', 'request_id': 'req-4967623c-d554-441e-ba05-b291b82a9d25'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.564176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fa4a5370b446f58b2461535f16e9d4', 'request_id': 'req-4967623c-d554-441e-ba05-b291b82a9d25'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.637887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fa4a5370b446f58b2461535f16e9d4', 'request_id': 'req-4967623c-d554-441e-ba05-b291b82a9d25'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.648973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] The token cache is being invalidate because project 24fa4a5370b446f58b2461535f16e9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:04.649268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.649915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-4967623c-d554-441e-ba05-b291b82a9d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:04.651658 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1342/2662] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:04 2022] DELETE /identity/v3/projects/24fa4a5370b446f58b2461535f16e9d4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:04.656860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ff412-e6c0-4cca-a483-5827f9515a7f None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:04.657146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ff412-e6c0-4cca-a483-5827f9515a7f None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:04.657422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ff412-e6c0-4cca-a483-5827f9515a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:04.678416 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ac4ff412-e6c0-4cca-a483-5827f9515a7f None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:04.679630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ac4ff412-e6c0-4cca-a483-5827f9515a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:04.740467 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1321/2663] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:04.748754 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535fddb-0628-41ad-a38f-59e5e1d15c20 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:04.749062 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535fddb-0628-41ad-a38f-59e5e1d15c20 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:04.749337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535fddb-0628-41ad-a38f-59e5e1d15c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:04.757933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:04.769807 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-e535fddb-0628-41ad-a38f-59e5e1d15c20 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:04.771026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e535fddb-0628-41ad-a38f-59e5e1d15c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:04.779370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1343/2664] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:04.784120 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ff412-e6c0-4cca-a483-5827f9515a7f None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:04.796617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ff412-e6c0-4cca-a483-5827f9515a7f None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:04.801245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:04.807065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:04.807065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:04.807065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:04.807065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:04.807065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:04.807065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:04.817198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1322/2665] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:42:04.821577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535fddb-0628-41ad-a38f-59e5e1d15c20 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:04.831267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535fddb-0628-41ad-a38f-59e5e1d15c20 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:04.837715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3296931-0845-4128-a74c-6dd49a7764b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:04.838446 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296931-0845-4128-a74c-6dd49a7764b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:04.838636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296931-0845-4128-a74c-6dd49a7764b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:04.838875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296931-0845-4128-a74c-6dd49a7764b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:04.839501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3296931-0845-4128-a74c-6dd49a7764b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:04.842061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3296931-0845-4128-a74c-6dd49a7764b9 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:04.948470 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1344/2666] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:04 2022] POST /identity/v3/projects => generated 353 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:04.953349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:04.963367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be179b9-c919-4402-a039-12b3f5a9f3d3 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:05.146865 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07e62c-b2e0-4e2c-84ab-c924edaf3295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:05.147498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e62c-b2e0-4e2c-84ab-c924edaf3295 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:05.147904 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e62c-b2e0-4e2c-84ab-c924edaf3295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:05.148186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07e62c-b2e0-4e2c-84ab-c924edaf3295 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:05.148829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07e62c-b2e0-4e2c-84ab-c924edaf3295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:05.150818 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07e62c-b2e0-4e2c-84ab-c924edaf3295 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:05.265197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1323/2667] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:04 2022] POST /identity/v3/users => generated 277 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:05.266430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3296931-0845-4128-a74c-6dd49a7764b9 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:05.277112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3296931-0845-4128-a74c-6dd49a7764b9 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:05.282513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1eb61-6c4f-447a-9262-c177dbfbd32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:05.283125 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1eb61-6c4f-447a-9262-c177dbfbd32c admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:05.283448 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1eb61-6c4f-447a-9262-c177dbfbd32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:05.283705 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1eb61-6c4f-447a-9262-c177dbfbd32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:05.284356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1eb61-6c4f-447a-9262-c177dbfbd32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:05.286045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1eb61-6c4f-447a-9262-c177dbfbd32c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:05.297050 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1345/2668] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:05.301196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07e62c-b2e0-4e2c-84ab-c924edaf3295 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:05.312022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07e62c-b2e0-4e2c-84ab-c924edaf3295 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:05.316912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f2fac-a961-4613-9001-4a62093ed9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:05.317520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2fac-a961-4613-9001-4a62093ed9ac admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:05.322207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2fac-a961-4613-9001-4a62093ed9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:05.322207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2fac-a961-4613-9001-4a62093ed9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:05.322207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f2fac-a961-4613-9001-4a62093ed9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:05.322207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f2fac-a961-4613-9001-4a62093ed9ac admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:05.331367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1324/2669] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:05.335629 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1eb61-6c4f-447a-9262-c177dbfbd32c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:05.352414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1eb61-6c4f-447a-9262-c177dbfbd32c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:05.352414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c45f32-6891-4f00-a7c8-e993d1f006fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:05.352414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c45f32-6891-4f00-a7c8-e993d1f006fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:05.352414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c45f32-6891-4f00-a7c8-e993d1f006fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:05.352958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c45f32-6891-4f00-a7c8-e993d1f006fc admin admin] PATH_INFO: `/v3/projects/0eb6dbc493464b809d122c36151d4227/users/f76afce051c24e5d98561371cc3a8ea6/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:05.380482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c45f32-6891-4f00-a7c8-e993d1f006fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb6dbc493464b809d122c36151d4227, user_id=f76afce051c24e5d98561371cc3a8ea6, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:05.380482 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c45f32-6891-4f00-a7c8-e993d1f006fc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:05.536732 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1346/2670] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:05 2022] PUT /identity/v3/projects/0eb6dbc493464b809d122c36151d4227/users/f76afce051c24e5d98561371cc3a8ea6/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:05.547803 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9d8d-3c6a-4161-86ab-2e3a68eb877b None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:05.548099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9d8d-3c6a-4161-86ab-2e3a68eb877b None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:05.548480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9d8d-3c6a-4161-86ab-2e3a68eb877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:05.556112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:05.578407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-c69f9d8d-3c6a-4161-86ab-2e3a68eb877b None None] MFA Rules not processed for user `f76afce051c24e5d98561371cc3a8ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:05.579717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c69f9d8d-3c6a-4161-86ab-2e3a68eb877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:05.644889 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1325/2671] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:05.649459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c45f32-6891-4f00-a7c8-e993d1f006fc admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:05.713342 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c45f32-6891-4f00-a7c8-e993d1f006fc admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:05.718662 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849866e-bc20-44e2-b45f-a21ab2082959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:05.719382 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849866e-bc20-44e2-b45f-a21ab2082959 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:05.722067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849866e-bc20-44e2-b45f-a21ab2082959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:05.722350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849866e-bc20-44e2-b45f-a21ab2082959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:05.723006 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849866e-bc20-44e2-b45f-a21ab2082959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:05.724953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849866e-bc20-44e2-b45f-a21ab2082959 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:05.861286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1347/2672] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:05 2022] POST /identity/v3/projects => generated 357 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:05.865445 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f9d8d-3c6a-4161-86ab-2e3a68eb877b None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:05.875878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f9d8d-3c6a-4161-86ab-2e3a68eb877b None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:05.932442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f41e0-a6f6-49d9-b71e-28598cb02cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:05.933125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f41e0-a6f6-49d9-b71e-28598cb02cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:05.933407 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f41e0-a6f6-49d9-b71e-28598cb02cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:05.933713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f41e0-a6f6-49d9-b71e-28598cb02cbb admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:05.934349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f41e0-a6f6-49d9-b71e-28598cb02cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:05.936272 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f41e0-a6f6-49d9-b71e-28598cb02cbb admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:06.055621 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1326/2673] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:05 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:06.060213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849866e-bc20-44e2-b45f-a21ab2082959 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:06.070505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849866e-bc20-44e2-b45f-a21ab2082959 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:06.074984 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa8b1-aa2d-4b7b-9686-39a360a03d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:06.076151 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa8b1-aa2d-4b7b-9686-39a360a03d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:06.076490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa8b1-aa2d-4b7b-9686-39a360a03d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:06.076764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa8b1-aa2d-4b7b-9686-39a360a03d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:06.077397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfa8b1-aa2d-4b7b-9686-39a360a03d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:06.079026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfa8b1-aa2d-4b7b-9686-39a360a03d0f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:06.089589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1348/2674] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:06.104198 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f41e0-a6f6-49d9-b71e-28598cb02cbb admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:06.114512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f41e0-a6f6-49d9-b71e-28598cb02cbb admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:06.119603 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc4d5-07f2-4b38-a47e-88e77be93d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:06.120293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc4d5-07f2-4b38-a47e-88e77be93d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:06.120576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc4d5-07f2-4b38-a47e-88e77be93d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:06.120853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fc4d5-07f2-4b38-a47e-88e77be93d72 admin admin] PATH_INFO: `/v3/projects/00481dd558bd4d24b4934b2a47138c53/users/40efbc45c1fb47fbad02e06fd5a355c6/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:06.136858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc4d5-07f2-4b38-a47e-88e77be93d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00481dd558bd4d24b4934b2a47138c53, user_id=40efbc45c1fb47fbad02e06fd5a355c6, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:06.140196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fc4d5-07f2-4b38-a47e-88e77be93d72 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:06.226320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1327/2675] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:06 2022] PUT /identity/v3/projects/00481dd558bd4d24b4934b2a47138c53/users/40efbc45c1fb47fbad02e06fd5a355c6/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:06.231527 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa8b1-aa2d-4b7b-9686-39a360a03d0f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:06.245999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa8b1-aa2d-4b7b-9686-39a360a03d0f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:06.305454 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36019e-46fe-458d-9e7c-2f5dfcd5229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:06.306090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36019e-46fe-458d-9e7c-2f5dfcd5229a admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:06.306367 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36019e-46fe-458d-9e7c-2f5dfcd5229a admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:06.306635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36019e-46fe-458d-9e7c-2f5dfcd5229a admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:06.307269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36019e-46fe-458d-9e7c-2f5dfcd5229a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:06.308868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36019e-46fe-458d-9e7c-2f5dfcd5229a admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:06.325996 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1349/2676] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:06.327499 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc4d5-07f2-4b38-a47e-88e77be93d72 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:06.339436 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fc4d5-07f2-4b38-a47e-88e77be93d72 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:06.345067 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:06.345319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:06.345406 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:06.345667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] PATH_INFO: `/v3/projects/00481dd558bd4d24b4934b2a47138c53/users/40efbc45c1fb47fbad02e06fd5a355c6/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:06.347610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00481dd558bd4d24b4934b2a47138c53, user_id=40efbc45c1fb47fbad02e06fd5a355c6, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:06.350333 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:06.361258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1328/2677] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:06 2022] PUT /identity/v3/projects/00481dd558bd4d24b4934b2a47138c53/users/40efbc45c1fb47fbad02e06fd5a355c6/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:06.374248 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fc08-91c8-4fb7-8a83-11ed6b903455 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:06.374465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fc08-91c8-4fb7-8a83-11ed6b903455 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:06.374744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4fc08-91c8-4fb7-8a83-11ed6b903455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:06.398375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:06.406821 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-afd4fc08-91c8-4fb7-8a83-11ed6b903455 None None] MFA Rules not processed for user `40efbc45c1fb47fbad02e06fd5a355c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:06.408028 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-afd4fc08-91c8-4fb7-8a83-11ed6b903455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:06.453643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:06.455555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:06.501180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1350/2678] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:06.506923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:06.512986 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4fc08-91c8-4fb7-8a83-11ed6b903455 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:06.514934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-afd4fc08-91c8-4fb7-8a83-11ed6b903455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:06.518399 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7156d4-ad60-41a5-b4e5-d0be7e492630 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:06.522472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:06.523319 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:06.523597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:06.523945 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:06.525695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:06.527962 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4fc08-91c8-4fb7-8a83-11ed6b903455 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:06.531765 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050abf54-de5e-490d-b8ea-c4cd219e869f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:06.532364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050abf54-de5e-490d-b8ea-c4cd219e869f service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:06.532643 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050abf54-de5e-490d-b8ea-c4cd219e869f service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:06.532909 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050abf54-de5e-490d-b8ea-c4cd219e869f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:06.546269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050abf54-de5e-490d-b8ea-c4cd219e869f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:06.547721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050abf54-de5e-490d-b8ea-c4cd219e869f service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:06.557539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1351/2679] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:42:06.594664 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:06.596141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:06.605738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1329/2680] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:42:06.768483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050abf54-de5e-490d-b8ea-c4cd219e869f service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:06.777877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050abf54-de5e-490d-b8ea-c4cd219e869f service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:06.781363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302ba77-691c-4e03-b1a7-0ce6e6b346e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:06.781988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302ba77-691c-4e03-b1a7-0ce6e6b346e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:06.782329 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302ba77-691c-4e03-b1a7-0ce6e6b346e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:06.782610 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302ba77-691c-4e03-b1a7-0ce6e6b346e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:06.842891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302ba77-691c-4e03-b1a7-0ce6e6b346e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:06.844355 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302ba77-691c-4e03-b1a7-0ce6e6b346e2 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:06.853989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1352/2681] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:11.899308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:11.900738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:11.968592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b28f75-e16d-4f5c-9d63-b43c3f6de7ee service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:11.973281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:11.973991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:11.974212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:11.974488 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] PATH_INFO: `/v3/users/33825f7a381f471cb0e66c1c3dc18aca` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:11.975704 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33825f7a381f471cb0e66c1c3dc18aca)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:11.977814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:12.251789 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33825f7a381f471cb0e66c1c3dc18aca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:12.258963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33825f7a381f471cb0e66c1c3dc18aca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:12.259574 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33825f7a381f471cb0e66c1c3dc18aca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:12.260200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33825f7a381f471cb0e66c1c3dc18aca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:12.276885 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33825f7a381f471cb0e66c1c3dc18aca'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:12.409180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1330/2682] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:11 2022] DELETE /identity/v3/users/33825f7a381f471cb0e66c1c3dc18aca => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:12.413838 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e84d8-d0f0-4016-a062-afc77569fa28 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:12.414356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e84d8-d0f0-4016-a062-afc77569fa28 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:12.414459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e84d8-d0f0-4016-a062-afc77569fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:12.433991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-974e84d8-d0f0-4016-a062-afc77569fa28 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:12.435176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-974e84d8-d0f0-4016-a062-afc77569fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:12.495488 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1353/2683] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:12.507963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:12.507963 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:12.523055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:12.579585 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7e506-0065-4975-b852-89f94827c944 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:12.584546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:12.585390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:12.585719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:12.586023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:12.597988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:12.599735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:12.610661 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1331/2684] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:13.114180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e84d8-d0f0-4016-a062-afc77569fa28 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:13.115700 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-974e84d8-d0f0-4016-a062-afc77569fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:13.128545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e84d8-d0f0-4016-a062-afc77569fa28 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:13.133930 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:13.146737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:13.146737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:13.146737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] PATH_INFO: `/v3/projects/894ec69ece9e4048baa11e16e4a21c91` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:13.146737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=894ec69ece9e4048baa11e16e4a21c91)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:13.146737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:13.160373 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:13.280194 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894ec69ece9e4048baa11e16e4a21c91', 'request_id': 'req-aff97bb2-7024-417c-a9ed-63a663614eb6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:13.286363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894ec69ece9e4048baa11e16e4a21c91', 'request_id': 'req-aff97bb2-7024-417c-a9ed-63a663614eb6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:13.363035 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894ec69ece9e4048baa11e16e4a21c91', 'request_id': 'req-aff97bb2-7024-417c-a9ed-63a663614eb6'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:13.374596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] The token cache is being invalidate because project 894ec69ece9e4048baa11e16e4a21c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:13.374831 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:13.375529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aff97bb2-7024-417c-a9ed-63a663614eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:13.377065 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1354/2685] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:13 2022] DELETE /identity/v3/projects/894ec69ece9e4048baa11e16e4a21c91 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:22.119320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:22.120852 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:22.197293 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ec657-43fd-49a8-b16e-89371cd52c69 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:22.253553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:22.254393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.254675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.254966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] PATH_INFO: `/v3/users/efc1aec9f292459baa4b0116a0635630` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.256100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc1aec9f292459baa4b0116a0635630)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:22.258072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:22.456546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc1aec9f292459baa4b0116a0635630'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.463267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc1aec9f292459baa4b0116a0635630'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.463933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc1aec9f292459baa4b0116a0635630'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.464549 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc1aec9f292459baa4b0116a0635630'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.466317 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:22.477233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc1aec9f292459baa4b0116a0635630'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:22.529196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1332/2686] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:22 2022] DELETE /identity/v3/users/efc1aec9f292459baa4b0116a0635630 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:22.533882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903387-1a7a-4422-9289-e7301cf91aba None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.534549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903387-1a7a-4422-9289-e7301cf91aba None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.534549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903387-1a7a-4422-9289-e7301cf91aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.562862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-6c903387-1a7a-4422-9289-e7301cf91aba None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:22.564258 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6c903387-1a7a-4422-9289-e7301cf91aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:22.624363 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1355/2687] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:22.634053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:22.635711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:22.709896 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0441420-000c-47e9-b181-8ec2163b72e9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:22.713364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540ca7f-23a0-497e-8925-b75d62907002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:22.713985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540ca7f-23a0-497e-8925-b75d62907002 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:22.714264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540ca7f-23a0-497e-8925-b75d62907002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:22.714531 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540ca7f-23a0-497e-8925-b75d62907002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:22.723733 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540ca7f-23a0-497e-8925-b75d62907002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:22.725154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540ca7f-23a0-497e-8925-b75d62907002 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:22.734408 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1333/2688] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:42:23.204300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c903387-1a7a-4422-9289-e7301cf91aba None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:23.205751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-6c903387-1a7a-4422-9289-e7301cf91aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:23.219919 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c903387-1a7a-4422-9289-e7301cf91aba None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:23.231292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:23.231292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:23.231292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:23.231292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] PATH_INFO: `/v3/projects/fa5ae54cdd464fcab51278d0f6f82d30` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:23.231717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5ae54cdd464fcab51278d0f6f82d30)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:23.231717 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:23.356850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5ae54cdd464fcab51278d0f6f82d30', 'request_id': 'req-83a7b0f8-975c-4a6a-8ef5-c442180cb720'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.363169 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5ae54cdd464fcab51278d0f6f82d30', 'request_id': 'req-83a7b0f8-975c-4a6a-8ef5-c442180cb720'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.448906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5ae54cdd464fcab51278d0f6f82d30', 'request_id': 'req-83a7b0f8-975c-4a6a-8ef5-c442180cb720'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.460184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] The token cache is being invalidate because project fa5ae54cdd464fcab51278d0f6f82d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:23.460501 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.461141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.462661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1356/2689] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:23 2022] DELETE /identity/v3/projects/fa5ae54cdd464fcab51278d0f6f82d30 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:23.472140 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540ca7f-23a0-497e-8925-b75d62907002 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:23.483006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540ca7f-23a0-497e-8925-b75d62907002 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:23.546442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:23.546597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:23.546924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:23.547125 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] PATH_INFO: `/v3/users/df53211aaaff47909683690d53161897` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:23.548422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df53211aaaff47909683690d53161897)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:23.550379 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:23.760872 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df53211aaaff47909683690d53161897'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.768172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df53211aaaff47909683690d53161897'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.773127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df53211aaaff47909683690d53161897'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.773127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df53211aaaff47909683690d53161897'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.774653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:23.782216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-eabc4ca0-07b5-48c9-9b30-4eae596c6b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df53211aaaff47909683690d53161897'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:23.837428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1334/2690] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:23 2022] DELETE /identity/v3/users/df53211aaaff47909683690d53161897 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:24.267445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:24.270001 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:24.282141 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7b0f8-975c-4a6a-8ef5-c442180cb720 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:24.301791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:24.341832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:24.342652 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:24.342931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:24.343232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] PATH_INFO: `/v3/projects/4f90b7b31c774ee29abf12d008f5318f` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:24.344580 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f90b7b31c774ee29abf12d008f5318f)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:24.346613 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:24.462270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f90b7b31c774ee29abf12d008f5318f', 'request_id': 'req-6e655d73-7e5f-4915-a673-544c44536440'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:24.470240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f90b7b31c774ee29abf12d008f5318f', 'request_id': 'req-6e655d73-7e5f-4915-a673-544c44536440'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:24.533719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f90b7b31c774ee29abf12d008f5318f', 'request_id': 'req-6e655d73-7e5f-4915-a673-544c44536440'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:24.545273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] The token cache is being invalidate because project 4f90b7b31c774ee29abf12d008f5318f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:24.545659 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:24.546443 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6e655d73-7e5f-4915-a673-544c44536440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:24.547991 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1357/2691] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:24 2022] DELETE /identity/v3/projects/4f90b7b31c774ee29abf12d008f5318f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:24.552975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b2375-94ef-47de-8cce-04031134056d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:24.553498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b2375-94ef-47de-8cce-04031134056d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:24.553749 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b2375-94ef-47de-8cce-04031134056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:24.601866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-324b2375-94ef-47de-8cce-04031134056d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:24.603069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-324b2375-94ef-47de-8cce-04031134056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:24.665659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1335/2692] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:24.673850 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235d98a-d1de-444d-89de-b79fb3f0f091 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:24.674138 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235d98a-d1de-444d-89de-b79fb3f0f091 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:24.674417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235d98a-d1de-444d-89de-b79fb3f0f091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:24.699898 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-8235d98a-d1de-444d-89de-b79fb3f0f091 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:24.701135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8235d98a-d1de-444d-89de-b79fb3f0f091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:24.709069 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1358/2693] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:24.713367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b2375-94ef-47de-8cce-04031134056d None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:24.723610 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b2375-94ef-47de-8cce-04031134056d None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:24.728253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:24.728971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:24.729091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:24.729365 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:24.730055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:24.730358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:24.731937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:24.743188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1336/2694] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:24.747729 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235d98a-d1de-444d-89de-b79fb3f0f091 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:24.757087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235d98a-d1de-444d-89de-b79fb3f0f091 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:24.763126 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4aca2-7327-4345-940d-2ef7c73ac2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:24.763713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4aca2-7327-4345-940d-2ef7c73ac2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:24.763995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4aca2-7327-4345-940d-2ef7c73ac2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:24.764276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4aca2-7327-4345-940d-2ef7c73ac2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:24.764899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4aca2-7327-4345-940d-2ef7c73ac2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:24.766918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4aca2-7327-4345-940d-2ef7c73ac2fb admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:24.833023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1359/2695] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:24 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:24.837410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:24.847375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bb91d-1806-4a8b-a71d-6a29521773d1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:24.903902 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d9728-6c21-4575-bb66-8433b43a7d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:24.904536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d9728-6c21-4575-bb66-8433b43a7d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:24.904816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d9728-6c21-4575-bb66-8433b43a7d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:24.905088 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d9728-6c21-4575-bb66-8433b43a7d31 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:24.905876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d9728-6c21-4575-bb66-8433b43a7d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:24.907780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d9728-6c21-4575-bb66-8433b43a7d31 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.014434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1337/2696] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:24 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:25.018504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4aca2-7327-4345-940d-2ef7c73ac2fb admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.028964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4aca2-7327-4345-940d-2ef7c73ac2fb admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.033944 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937ed94-f058-4b5f-88f8-af091e1484b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.034549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937ed94-f058-4b5f-88f8-af091e1484b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.034833 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937ed94-f058-4b5f-88f8-af091e1484b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.035109 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937ed94-f058-4b5f-88f8-af091e1484b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.035761 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937ed94-f058-4b5f-88f8-af091e1484b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.037360 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937ed94-f058-4b5f-88f8-af091e1484b2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.047647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1360/2697] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:25.053707 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d9728-6c21-4575-bb66-8433b43a7d31 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.064385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d9728-6c21-4575-bb66-8433b43a7d31 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.068962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1026f-1259-41ba-b560-43f7b863d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.069557 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1026f-1259-41ba-b560-43f7b863d425 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.069871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1026f-1259-41ba-b560-43f7b863d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.070148 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1026f-1259-41ba-b560-43f7b863d425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.070795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1026f-1259-41ba-b560-43f7b863d425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.072419 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1026f-1259-41ba-b560-43f7b863d425 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.085362 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1338/2698] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:25.088370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937ed94-f058-4b5f-88f8-af091e1484b2 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.098558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937ed94-f058-4b5f-88f8-af091e1484b2 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.103834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90417-eeb8-49d0-9d93-a0d06afc3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.104589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90417-eeb8-49d0-9d93-a0d06afc3f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.105053 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90417-eeb8-49d0-9d93-a0d06afc3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.105445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90417-eeb8-49d0-9d93-a0d06afc3f12 admin admin] PATH_INFO: `/v3/projects/b112ec63ddf8483085c507c72fb0b12c/users/7e41840a43ae4ffdbbda07daa8c76a54/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.121222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a90417-eeb8-49d0-9d93-a0d06afc3f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b112ec63ddf8483085c507c72fb0b12c, user_id=7e41840a43ae4ffdbbda07daa8c76a54, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.123932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a90417-eeb8-49d0-9d93-a0d06afc3f12 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.266997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1361/2699] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:25 2022] PUT /identity/v3/projects/b112ec63ddf8483085c507c72fb0b12c/users/7e41840a43ae4ffdbbda07daa8c76a54/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:25.278915 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89858-685c-4246-b4c8-37d7048299f8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.279202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89858-685c-4246-b4c8-37d7048299f8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.279478 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89858-685c-4246-b4c8-37d7048299f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.306597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e8c89858-685c-4246-b4c8-37d7048299f8 None None] MFA Rules not processed for user `7e41840a43ae4ffdbbda07daa8c76a54`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:25.307809 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e8c89858-685c-4246-b4c8-37d7048299f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:25.316863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:25.374182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1339/2700] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:25.378685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90417-eeb8-49d0-9d93-a0d06afc3f12 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.426949 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:25.440238 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90417-eeb8-49d0-9d93-a0d06afc3f12 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.444870 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977bc3-eeaa-4efb-bff6-68813712aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.445481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977bc3-eeaa-4efb-bff6-68813712aeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.445796 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977bc3-eeaa-4efb-bff6-68813712aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.446074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977bc3-eeaa-4efb-bff6-68813712aeb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.446706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43977bc3-eeaa-4efb-bff6-68813712aeb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.448616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43977bc3-eeaa-4efb-bff6-68813712aeb8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.551424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1362/2701] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:25 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:25.555372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c89858-685c-4246-b4c8-37d7048299f8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.566367 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c89858-685c-4246-b4c8-37d7048299f8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.622141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0f4b-dd3b-4824-bcee-d7a47c99450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.622886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0f4b-dd3b-4824-bcee-d7a47c99450e admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.623177 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0f4b-dd3b-4824-bcee-d7a47c99450e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.623452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c0f4b-dd3b-4824-bcee-d7a47c99450e admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.624168 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c0f4b-dd3b-4824-bcee-d7a47c99450e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.626188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c0f4b-dd3b-4824-bcee-d7a47c99450e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.693466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1340/2702] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:25 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:25.698375 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977bc3-eeaa-4efb-bff6-68813712aeb8 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.709680 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977bc3-eeaa-4efb-bff6-68813712aeb8 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.715371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da4067-3cce-41da-a087-40e3116b5fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.715979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da4067-3cce-41da-a087-40e3116b5fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.716264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da4067-3cce-41da-a087-40e3116b5fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.716634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da4067-3cce-41da-a087-40e3116b5fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.717286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da4067-3cce-41da-a087-40e3116b5fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.718941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da4067-3cce-41da-a087-40e3116b5fd6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.733034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1363/2703] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:25.740102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0f4b-dd3b-4824-bcee-d7a47c99450e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.747514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c0f4b-dd3b-4824-bcee-d7a47c99450e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.752364 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ea5aa-63f7-4039-aca8-fa4ae8ee1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.753023 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea5aa-63f7-4039-aca8-fa4ae8ee1a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.753301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea5aa-63f7-4039-aca8-fa4ae8ee1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.753580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ea5aa-63f7-4039-aca8-fa4ae8ee1a9a admin admin] PATH_INFO: `/v3/projects/c75dbb545dd14bf2b3c9c6839e81f84e/users/f0732e041eeb49fc85cca131b2a975d8/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.768735 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ea5aa-63f7-4039-aca8-fa4ae8ee1a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75dbb545dd14bf2b3c9c6839e81f84e, user_id=f0732e041eeb49fc85cca131b2a975d8, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.771372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ea5aa-63f7-4039-aca8-fa4ae8ee1a9a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.836573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1341/2704] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:25 2022] PUT /identity/v3/projects/c75dbb545dd14bf2b3c9c6839e81f84e/users/f0732e041eeb49fc85cca131b2a975d8/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:25.841135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da4067-3cce-41da-a087-40e3116b5fd6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.851315 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da4067-3cce-41da-a087-40e3116b5fd6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.910100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685072c-7e24-47c4-8318-e9c70bf3f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.910718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685072c-7e24-47c4-8318-e9c70bf3f560 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.911019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685072c-7e24-47c4-8318-e9c70bf3f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.911286 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685072c-7e24-47c4-8318-e9c70bf3f560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.911936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685072c-7e24-47c4-8318-e9c70bf3f560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.913563 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685072c-7e24-47c4-8318-e9c70bf3f560 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.925747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1364/2705] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:25.928927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ea5aa-63f7-4039-aca8-fa4ae8ee1a9a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:25.940978 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ea5aa-63f7-4039-aca8-fa4ae8ee1a9a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:25.945747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:25.946434 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.946786 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.947128 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] PATH_INFO: `/v3/projects/c75dbb545dd14bf2b3c9c6839e81f84e/users/f0732e041eeb49fc85cca131b2a975d8/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:25.949682 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75dbb545dd14bf2b3c9c6839e81f84e, user_id=f0732e041eeb49fc85cca131b2a975d8, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:25.952290 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:25.963138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1342/2706] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:25 2022] PUT /identity/v3/projects/c75dbb545dd14bf2b3c9c6839e81f84e/users/f0732e041eeb49fc85cca131b2a975d8/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:25.974543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bcf67-0b04-40a7-a2e9-76e1c8a9e3eb None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:25.974836 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bcf67-0b04-40a7-a2e9-76e1c8a9e3eb None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:25.975114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bcf67-0b04-40a7-a2e9-76e1c8a9e3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:26.005252 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-283bcf67-0b04-40a7-a2e9-76e1c8a9e3eb None None] MFA Rules not processed for user `f0732e041eeb49fc85cca131b2a975d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:26.006655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-283bcf67-0b04-40a7-a2e9-76e1c8a9e3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:26.084338 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1365/2707] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:26.095649 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:26.097389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:26.158188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16725a36-b02b-45eb-b4c9-373b0d68092d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:26.161723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:26.162439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:26.162597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:26.162869 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:26.172118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:26.173595 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:26.183314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1343/2708] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:26.285357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bcf67-0b04-40a7-a2e9-76e1c8a9e3eb None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:26.295809 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bcf67-0b04-40a7-a2e9-76e1c8a9e3eb None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:26.299472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458b404-77d3-47c8-a412-baaeeedebda2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:26.300064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b404-77d3-47c8-a412-baaeeedebda2 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:26.300346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b404-77d3-47c8-a412-baaeeedebda2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:26.300620 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b404-77d3-47c8-a412-baaeeedebda2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:26.357425 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:26.372640 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458b404-77d3-47c8-a412-baaeeedebda2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:26.374288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458b404-77d3-47c8-a412-baaeeedebda2 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:26.383422 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1366/2709] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:26.475738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:26.477269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:26.487843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:26.545139 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71a377-0c5c-40b8-a7e9-c4b62ab94f05 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:26.549726 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:26.550345 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:26.550620 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:26.550888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] PATH_INFO: `/v3/users/f76afce051c24e5d98561371cc3a8ea6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:26.551992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76afce051c24e5d98561371cc3a8ea6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:26.553906 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:26.764421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76afce051c24e5d98561371cc3a8ea6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:26.771197 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76afce051c24e5d98561371cc3a8ea6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:26.771854 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76afce051c24e5d98561371cc3a8ea6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:26.772457 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76afce051c24e5d98561371cc3a8ea6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:26.784561 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76afce051c24e5d98561371cc3a8ea6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:26.875477 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1344/2710] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:26 2022] DELETE /identity/v3/users/f76afce051c24e5d98561371cc3a8ea6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:26.880131 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5263aae-882f-4617-ad2c-666340acf556 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:26.880424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5263aae-882f-4617-ad2c-666340acf556 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:26.880749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5263aae-882f-4617-ad2c-666340acf556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:26.899210 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-f5263aae-882f-4617-ad2c-666340acf556 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:26.900428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f5263aae-882f-4617-ad2c-666340acf556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:26.958414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1367/2711] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:26.971151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:26.971151 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:27.045518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00159-507a-4851-81c1-51bb7d12193d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:27.050485 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20755ed-5c7e-48a5-a140-2f631749e974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:27.051420 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20755ed-5c7e-48a5-a140-2f631749e974 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:27.057335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20755ed-5c7e-48a5-a140-2f631749e974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:27.057335 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20755ed-5c7e-48a5-a140-2f631749e974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:27.067536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20755ed-5c7e-48a5-a140-2f631749e974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:27.069150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20755ed-5c7e-48a5-a140-2f631749e974 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:27.083286 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1345/2712] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:27.553061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5263aae-882f-4617-ad2c-666340acf556 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:27.555144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f5263aae-882f-4617-ad2c-666340acf556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:27.568691 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5263aae-882f-4617-ad2c-666340acf556 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:27.574458 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:27.575205 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:27.575400 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:27.575747 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] PATH_INFO: `/v3/projects/0eb6dbc493464b809d122c36151d4227` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:27.576939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb6dbc493464b809d122c36151d4227)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:27.579064 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:27.705638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb6dbc493464b809d122c36151d4227', 'request_id': 'req-5dff2d05-9b61-42df-a7fa-c6037536ac1d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:27.713093 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb6dbc493464b809d122c36151d4227', 'request_id': 'req-5dff2d05-9b61-42df-a7fa-c6037536ac1d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:27.772411 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb6dbc493464b809d122c36151d4227', 'request_id': 'req-5dff2d05-9b61-42df-a7fa-c6037536ac1d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:27.783585 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] The token cache is being invalidate because project 0eb6dbc493464b809d122c36151d4227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:27.783915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:27.784536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:27.786045 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1368/2713] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:27 2022] DELETE /identity/v3/projects/0eb6dbc493464b809d122c36151d4227 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:27.790104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20755ed-5c7e-48a5-a140-2f631749e974 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:27.800137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20755ed-5c7e-48a5-a140-2f631749e974 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:27.826210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:27.861917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:27.862548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:27.862832 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:27.863202 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] PATH_INFO: `/v3/users/40efbc45c1fb47fbad02e06fd5a355c6` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:27.864405 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40efbc45c1fb47fbad02e06fd5a355c6)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:27.866431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:28.046154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40efbc45c1fb47fbad02e06fd5a355c6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.053270 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40efbc45c1fb47fbad02e06fd5a355c6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.059475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40efbc45c1fb47fbad02e06fd5a355c6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.060339 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40efbc45c1fb47fbad02e06fd5a355c6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.073374 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-16651730-f684-4a21-9020-b02f659c16f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40efbc45c1fb47fbad02e06fd5a355c6'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.147185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1346/2714] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:27 2022] DELETE /identity/v3/users/40efbc45c1fb47fbad02e06fd5a355c6 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:28.604137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:28.605842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:28.631226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff2d05-9b61-42df-a7fa-c6037536ac1d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:28.688292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:28.692396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:28.692396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:28.692396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] PATH_INFO: `/v3/projects/00481dd558bd4d24b4934b2a47138c53` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:28.692396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00481dd558bd4d24b4934b2a47138c53)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:28.692797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:28.701817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:28.842827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00481dd558bd4d24b4934b2a47138c53', 'request_id': 'req-1a7ce6a4-3796-431e-8684-85f3c97fe79c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.849079 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00481dd558bd4d24b4934b2a47138c53', 'request_id': 'req-1a7ce6a4-3796-431e-8684-85f3c97fe79c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.966952 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00481dd558bd4d24b4934b2a47138c53', 'request_id': 'req-1a7ce6a4-3796-431e-8684-85f3c97fe79c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.978129 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] The token cache is being invalidate because project 00481dd558bd4d24b4934b2a47138c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:28.978425 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.979056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1a7ce6a4-3796-431e-8684-85f3c97fe79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:28.981241 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1369/2715] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:28 2022] DELETE /identity/v3/projects/00481dd558bd4d24b4934b2a47138c53 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:28.985931 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad484-ae90-4afe-9c7e-6f5c585ccd33 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:28.986472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad484-ae90-4afe-9c7e-6f5c585ccd33 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:28.986573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad484-ae90-4afe-9c7e-6f5c585ccd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.006314 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-5e7ad484-ae90-4afe-9c7e-6f5c585ccd33 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:29.007528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5e7ad484-ae90-4afe-9c7e-6f5c585ccd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:29.066720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1347/2716] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:29.074714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e7bd-b1b7-45fb-b811-5b2465c674fe None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.076794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e7bd-b1b7-45fb-b811-5b2465c674fe None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.076794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e7bd-b1b7-45fb-b811-5b2465c674fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.094578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-5381e7bd-b1b7-45fb-b811-5b2465c674fe None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:29.095753 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5381e7bd-b1b7-45fb-b811-5b2465c674fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:29.103622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1370/2717] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:29.108545 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ad484-ae90-4afe-9c7e-6f5c585ccd33 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:29.118322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ad484-ae90-4afe-9c7e-6f5c585ccd33 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:29.123196 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:29.123780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.124062 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.124330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.124986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:29.125359 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:29.127165 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:29.139927 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1348/2718] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:29.144372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e7bd-b1b7-45fb-b811-5b2465c674fe None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:29.154158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381e7bd-b1b7-45fb-b811-5b2465c674fe None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:29.159413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147af1d-6e0b-47e7-b5d4-de0751cc126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:29.159987 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147af1d-6e0b-47e7-b5d4-de0751cc126d admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.160264 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147af1d-6e0b-47e7-b5d4-de0751cc126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.160533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147af1d-6e0b-47e7-b5d4-de0751cc126d admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.161192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147af1d-6e0b-47e7-b5d4-de0751cc126d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:29.163222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147af1d-6e0b-47e7-b5d4-de0751cc126d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:29.293882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1371/2719] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:29 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:29.298219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:29.309008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09776c3d-144e-450a-9da5-265355083051 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:29.344127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:29.368692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811900e2-036b-45c5-bfc7-81bffb118a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:29.369225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811900e2-036b-45c5-bfc7-81bffb118a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.369508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811900e2-036b-45c5-bfc7-81bffb118a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.369816 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811900e2-036b-45c5-bfc7-81bffb118a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.370964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811900e2-036b-45c5-bfc7-81bffb118a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:29.372888 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811900e2-036b-45c5-bfc7-81bffb118a44 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:29.517925 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1349/2720] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:29 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:29.522147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147af1d-6e0b-47e7-b5d4-de0751cc126d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:29.532548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147af1d-6e0b-47e7-b5d4-de0751cc126d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:29.537174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4683-4254-4028-9e6a-5ddd138e521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:29.537800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4683-4254-4028-9e6a-5ddd138e521c admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.538164 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4683-4254-4028-9e6a-5ddd138e521c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.538434 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e4683-4254-4028-9e6a-5ddd138e521c admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.539102 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e4683-4254-4028-9e6a-5ddd138e521c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:29.540698 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e4683-4254-4028-9e6a-5ddd138e521c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:29.554973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1372/2721] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:29.556423 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811900e2-036b-45c5-bfc7-81bffb118a44 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:29.569554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811900e2-036b-45c5-bfc7-81bffb118a44 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:29.574914 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:29.575539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.575822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.576100 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.576817 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:29.578484 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:29.593762 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1350/2722] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:29.597793 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4683-4254-4028-9e6a-5ddd138e521c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:29.598829 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:29.601734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:29.605516 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e4683-4254-4028-9e6a-5ddd138e521c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:29.610430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:29.611176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.611531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.611877 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] PATH_INFO: `/v3/projects/69b6ce37f24343a69d229861b45a5c70/users/e838d638bace4c1093ca5bb82d47d5d3/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.616003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b785e-95ec-4987-baf3-8ee97f7aa525 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:29.622094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:29.622842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.623194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.623530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] PATH_INFO: `/v3/users/7e41840a43ae4ffdbbda07daa8c76a54` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.624732 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e41840a43ae4ffdbbda07daa8c76a54)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:29.626804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:29.628077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b6ce37f24343a69d229861b45a5c70, user_id=e838d638bace4c1093ca5bb82d47d5d3, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:29.631168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:29.707520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1373/2723] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:29 2022] PUT /identity/v3/projects/69b6ce37f24343a69d229861b45a5c70/users/e838d638bace4c1093ca5bb82d47d5d3/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:29.711063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:29.718343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:29.778099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a76ae2-81b9-4761-a31e-d970e4f81140 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:29.782738 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:29.783366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.783752 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.784042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] PATH_INFO: `/v3/users/ade4a956715a4403a9369f8c9d3c9e1d` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.785211 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade4a956715a4403a9369f8c9d3c9e1d)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:29.787160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:29.828632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e41840a43ae4ffdbbda07daa8c76a54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:29.835613 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e41840a43ae4ffdbbda07daa8c76a54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:29.836312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e41840a43ae4ffdbbda07daa8c76a54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:29.836935 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e41840a43ae4ffdbbda07daa8c76a54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:29.848718 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d462f910-7d3f-496c-8209-fd3c41e32d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e41840a43ae4ffdbbda07daa8c76a54'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:29.932678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1351/2724] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:29 2022] DELETE /identity/v3/users/7e41840a43ae4ffdbbda07daa8c76a54 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:29.934544 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aed96-42a3-4733-a3d6-cf6c24b04e06 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:29.934857 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aed96-42a3-4733-a3d6-cf6c24b04e06 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:29.935135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aed96-42a3-4733-a3d6-cf6c24b04e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:29.962600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-864aed96-42a3-4733-a3d6-cf6c24b04e06 None None] MFA Rules not processed for user `e838d638bace4c1093ca5bb82d47d5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:29.963815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-864aed96-42a3-4733-a3d6-cf6c24b04e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:29.994744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:30.004186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade4a956715a4403a9369f8c9d3c9e1d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:30.004828 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade4a956715a4403a9369f8c9d3c9e1d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:30.005522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade4a956715a4403a9369f8c9d3c9e1d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:30.027575 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1352/2725] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:30.028831 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab31b3-118f-4efd-a55f-ff490126184c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.029118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab31b3-118f-4efd-a55f-ff490126184c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.030357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab31b3-118f-4efd-a55f-ff490126184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.047944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-4cab31b3-118f-4efd-a55f-ff490126184c None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:30.049143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4cab31b3-118f-4efd-a55f-ff490126184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:30.059833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:30.077399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade4a956715a4403a9369f8c9d3c9e1d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:30.095121 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade4a956715a4403a9369f8c9d3c9e1d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:30.108679 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1374/2726] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:29 2022] DELETE /identity/v3/users/ade4a956715a4403a9369f8c9d3c9e1d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:30.109727 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.112032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:30.117427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1353/2727] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:30.117427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663473de-3b1c-48a1-b76d-39afb8f616d8 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.117427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663473de-3b1c-48a1-b76d-39afb8f616d8 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.117427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663473de-3b1c-48a1-b76d-39afb8f616d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.136083 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-663473de-3b1c-48a1-b76d-39afb8f616d8 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:30.137271 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-663473de-3b1c-48a1-b76d-39afb8f616d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:30.179624 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71030c69-97f7-453f-8062-301cd355c571 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.184277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b03d10-7028-4f4e-a2d1-2ec41034fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:30.184823 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b03d10-7028-4f4e-a2d1-2ec41034fae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.185106 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b03d10-7028-4f4e-a2d1-2ec41034fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.185379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b03d10-7028-4f4e-a2d1-2ec41034fae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.186043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b03d10-7028-4f4e-a2d1-2ec41034fae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:30.187980 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b03d10-7028-4f4e-a2d1-2ec41034fae5 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:30.199757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1354/2728] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:30.200706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663473de-3b1c-48a1-b76d-39afb8f616d8 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.202145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-663473de-3b1c-48a1-b76d-39afb8f616d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:30.259400 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663473de-3b1c-48a1-b76d-39afb8f616d8 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.263475 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95536d-4e1c-4db1-9392-be4f7e00d917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:30.264075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95536d-4e1c-4db1-9392-be4f7e00d917 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.264357 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95536d-4e1c-4db1-9392-be4f7e00d917 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.264632 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95536d-4e1c-4db1-9392-be4f7e00d917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.273431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95536d-4e1c-4db1-9392-be4f7e00d917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:30.274917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95536d-4e1c-4db1-9392-be4f7e00d917 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:30.284612 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1355/2729] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:30.285398 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95536d-4e1c-4db1-9392-be4f7e00d917 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.294149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95536d-4e1c-4db1-9392-be4f7e00d917 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.298410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfe991-c4ab-4002-ab6b-c187f6b0a956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:30.299118 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfe991-c4ab-4002-ab6b-c187f6b0a956 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.299502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfe991-c4ab-4002-ab6b-c187f6b0a956 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.299877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfe991-c4ab-4002-ab6b-c187f6b0a956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.302472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1375/2730] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:30 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:30.306586 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b03d10-7028-4f4e-a2d1-2ec41034fae5 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.313871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfe991-c4ab-4002-ab6b-c187f6b0a956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:30.315358 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfe991-c4ab-4002-ab6b-c187f6b0a956 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:30.325765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1356/2731] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:30.376587 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b03d10-7028-4f4e-a2d1-2ec41034fae5 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.381478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53071c2-3bdd-4ba9-aaa6-b77a5fff2f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:30.382124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53071c2-3bdd-4ba9-aaa6-b77a5fff2f13 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.382404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53071c2-3bdd-4ba9-aaa6-b77a5fff2f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.383174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53071c2-3bdd-4ba9-aaa6-b77a5fff2f13 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.383617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53071c2-3bdd-4ba9-aaa6-b77a5fff2f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:30.386160 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53071c2-3bdd-4ba9-aaa6-b77a5fff2f13 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:30.476995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1376/2732] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:30 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:30.480997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfe991-c4ab-4002-ab6b-c187f6b0a956 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.491015 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfe991-c4ab-4002-ab6b-c187f6b0a956 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.495619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d15d4-e7e2-473e-85f7-febe13bca5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:30.496219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d15d4-e7e2-473e-85f7-febe13bca5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.496500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d15d4-e7e2-473e-85f7-febe13bca5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.496772 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d15d4-e7e2-473e-85f7-febe13bca5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.497411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d15d4-e7e2-473e-85f7-febe13bca5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:30.499091 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d15d4-e7e2-473e-85f7-febe13bca5e2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:30.509322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1357/2733] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:30.517514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53071c2-3bdd-4ba9-aaa6-b77a5fff2f13 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.528595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53071c2-3bdd-4ba9-aaa6-b77a5fff2f13 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.533451 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbd521-8f9b-4da6-bed4-326a4a16aa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:30.534463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd521-8f9b-4da6-bed4-326a4a16aa0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.534755 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd521-8f9b-4da6-bed4-326a4a16aa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.537368 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd521-8f9b-4da6-bed4-326a4a16aa0d admin admin] PATH_INFO: `/v3/projects/b1353b429d7d46edb870ac17e13040c2/users/9528c0c4cfe84e6a842806ae2d33a12f/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.550711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbd521-8f9b-4da6-bed4-326a4a16aa0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1353b429d7d46edb870ac17e13040c2, user_id=9528c0c4cfe84e6a842806ae2d33a12f, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:30.553600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbd521-8f9b-4da6-bed4-326a4a16aa0d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:30.635966 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1377/2734] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:30 2022] PUT /identity/v3/projects/b1353b429d7d46edb870ac17e13040c2/users/9528c0c4cfe84e6a842806ae2d33a12f/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:30.637375 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d15d4-e7e2-473e-85f7-febe13bca5e2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.651495 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d15d4-e7e2-473e-85f7-febe13bca5e2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.693346 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:30.721535 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d36f28-a5df-4653-9bac-2bcd75f2eff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:30.722320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d36f28-a5df-4653-9bac-2bcd75f2eff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.722600 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d36f28-a5df-4653-9bac-2bcd75f2eff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.722866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d36f28-a5df-4653-9bac-2bcd75f2eff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.723510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d36f28-a5df-4653-9bac-2bcd75f2eff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:30.725917 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d36f28-a5df-4653-9bac-2bcd75f2eff9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:30.743647 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1358/2735] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:30.745553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbd521-8f9b-4da6-bed4-326a4a16aa0d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.752637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:30.758709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbd521-8f9b-4da6-bed4-326a4a16aa0d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.764957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:30.765950 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.766406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.766846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] PATH_INFO: `/v3/projects/b1353b429d7d46edb870ac17e13040c2/users/9528c0c4cfe84e6a842806ae2d33a12f/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.782539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1353b429d7d46edb870ac17e13040c2, user_id=9528c0c4cfe84e6a842806ae2d33a12f, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:30.788312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:30.809972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1378/2736] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:30 2022] PUT /identity/v3/projects/b1353b429d7d46edb870ac17e13040c2/users/9528c0c4cfe84e6a842806ae2d33a12f/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:30.820254 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9010a-b24e-45d5-861f-aeb3aa16dbbc None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:30.820590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9010a-b24e-45d5-861f-aeb3aa16dbbc None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:30.820842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9010a-b24e-45d5-861f-aeb3aa16dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:30.851050 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-39d9010a-b24e-45d5-861f-aeb3aa16dbbc None None] MFA Rules not processed for user `9528c0c4cfe84e6a842806ae2d33a12f`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:30.852265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-39d9010a-b24e-45d5-861f-aeb3aa16dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:30.880590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.891176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:30.980494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1359/2737] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:30.982859 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9010a-b24e-45d5-861f-aeb3aa16dbbc None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:30.983996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-39d9010a-b24e-45d5-861f-aeb3aa16dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:30.998074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800edf7-7ba9-400c-9f74-57a8e9dea38d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:30.998427 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9010a-b24e-45d5-861f-aeb3aa16dbbc None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:31.002861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.003709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.004339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.005143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.005143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] PATH_INFO: `/v3/projects/b112ec63ddf8483085c507c72fb0b12c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.005352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.005550 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.005855 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] PATH_INFO: `/v3/projects/bf1ec79a765c450e9570998566a8c43e` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.006967 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b112ec63ddf8483085c507c72fb0b12c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.007086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1ec79a765c450e9570998566a8c43e)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.008860 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.008975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.191974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1ec79a765c450e9570998566a8c43e', 'request_id': 'req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.220857 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b112ec63ddf8483085c507c72fb0b12c', 'request_id': 'req-891c69cf-7356-4f0d-9734-647219109cf1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.227721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b112ec63ddf8483085c507c72fb0b12c', 'request_id': 'req-891c69cf-7356-4f0d-9734-647219109cf1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.292997 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1ec79a765c450e9570998566a8c43e', 'request_id': 'req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.300004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1ec79a765c450e9570998566a8c43e', 'request_id': 'req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.311160 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] The token cache is being invalidate because project bf1ec79a765c450e9570998566a8c43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:31.311444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.312098 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.313701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1360/2738] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:30 2022] DELETE /identity/v3/projects/bf1ec79a765c450e9570998566a8c43e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:31.314465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:31.315745 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:31.349741 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b112ec63ddf8483085c507c72fb0b12c', 'request_id': 'req-891c69cf-7356-4f0d-9734-647219109cf1'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.362261 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:31.364626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] The token cache is being invalidate because project b112ec63ddf8483085c507c72fb0b12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:31.365021 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.365718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-891c69cf-7356-4f0d-9734-647219109cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.367339 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1379/2739] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:30 2022] DELETE /identity/v3/projects/b112ec63ddf8483085c507c72fb0b12c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:31.371657 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08771f31-6f19-4f8f-958f-8861f0da97af None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.371947 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08771f31-6f19-4f8f-958f-8861f0da97af None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.372226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08771f31-6f19-4f8f-958f-8861f0da97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.376194 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03be5-b1af-4d69-b7e0-6ba8b7b1669a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:31.392412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-08771f31-6f19-4f8f-958f-8861f0da97af None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:31.393726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-08771f31-6f19-4f8f-958f-8861f0da97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:31.427020 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7f75e-0c1e-46f9-a2a3-f8714b760101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.427696 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f75e-0c1e-46f9-a2a3-f8714b760101 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.427969 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f75e-0c1e-46f9-a2a3-f8714b760101 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.428219 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f75e-0c1e-46f9-a2a3-f8714b760101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.430518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f6a7f75e-0c1e-46f9-a2a3-f8714b760101 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:31.454878 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1380/2740] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:31.455886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08771f31-6f19-4f8f-958f-8861f0da97af None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:31.457645 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-08771f31-6f19-4f8f-958f-8861f0da97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:31.469275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08771f31-6f19-4f8f-958f-8861f0da97af None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:31.474204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.474903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.475275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.475635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] PATH_INFO: `/v3/users/f0732e041eeb49fc85cca131b2a975d8` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.476852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0732e041eeb49fc85cca131b2a975d8)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.478852 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.494973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:31.495311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7f75e-0c1e-46f9-a2a3-f8714b760101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.497601 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7f75e-0c1e-46f9-a2a3-f8714b760101 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.507583 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1361/2741] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:31.508840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729a02-32c1-4c26-9c34-f0969456f666 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.509124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729a02-32c1-4c26-9c34-f0969456f666 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.509653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729a02-32c1-4c26-9c34-f0969456f666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.528746 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-25729a02-32c1-4c26-9c34-f0969456f666 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:31.530090 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-25729a02-32c1-4c26-9c34-f0969456f666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:31.538045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1362/2742] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:31.542182 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25729a02-32c1-4c26-9c34-f0969456f666 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:31.551912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25729a02-32c1-4c26-9c34-f0969456f666 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:31.556741 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.557348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.557654 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.557988 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.558629 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:31.558929 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.560567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.571996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1363/2743] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:42:31.576424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:31.586237 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7ed1b-b2f0-4dd3-ae6d-b312efaa5db7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:31.591296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.591871 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.592152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.592424 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.593036 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.594938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.667088 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0732e041eeb49fc85cca131b2a975d8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.668349 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0732e041eeb49fc85cca131b2a975d8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.668979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0732e041eeb49fc85cca131b2a975d8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.683850 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1364/2744] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:31 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:31.687940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:31.689508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:31.752368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395bc25-c667-4c78-b462-6126cf326c92 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:31.755685 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0732e041eeb49fc85cca131b2a975d8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.757203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47d9c4-11d1-4e24-a868-15fcdc09d201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.757838 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d9c4-11d1-4e24-a868-15fcdc09d201 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.758122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d9c4-11d1-4e24-a868-15fcdc09d201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.758763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d9c4-11d1-4e24-a868-15fcdc09d201 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.759029 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47d9c4-11d1-4e24-a868-15fcdc09d201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.761713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47d9c4-11d1-4e24-a868-15fcdc09d201 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.770513 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0732e041eeb49fc85cca131b2a975d8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:31.771251 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:31.783387 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1381/2745] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:31 2022] DELETE /identity/v3/users/f0732e041eeb49fc85cca131b2a975d8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:31.784176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:31.785481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:31.843589 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379e0be-d424-4e95-ac7a-b71dac7d323e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:31.847492 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.848100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.848379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.848650 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.850429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:31.910876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.914692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1365/2746] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:31 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:31.914839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.919567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47d9c4-11d1-4e24-a868-15fcdc09d201 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:31.922114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1382/2747] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:31.925923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47d9c4-11d1-4e24-a868-15fcdc09d201 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:31.982713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4621d0f-7725-4883-b83e-29d910e4ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:31.983320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621d0f-7725-4883-b83e-29d910e4ff13 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:31.983652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621d0f-7725-4883-b83e-29d910e4ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:31.983868 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621d0f-7725-4883-b83e-29d910e4ff13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:31.984505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4621d0f-7725-4883-b83e-29d910e4ff13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:31.986130 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4621d0f-7725-4883-b83e-29d910e4ff13 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:31.996651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1366/2748] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:32.000437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:32.011961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df502147-bca6-476b-b041-c51d610c7aa1 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:32.016578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb570ad-e43e-411b-b015-77167c99c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:32.017178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb570ad-e43e-411b-b015-77167c99c171 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.017468 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb570ad-e43e-411b-b015-77167c99c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.017772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb570ad-e43e-411b-b015-77167c99c171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.018417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb570ad-e43e-411b-b015-77167c99c171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:32.020103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb570ad-e43e-411b-b015-77167c99c171 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:32.031734 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1383/2749] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:32.041759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4621d0f-7725-4883-b83e-29d910e4ff13 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:32.052713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4621d0f-7725-4883-b83e-29d910e4ff13 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:32.058887 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:32.059760 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.060225 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.060858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] PATH_INFO: `/v3/projects/50bfac90100e47ec858867a64c6c2846/users/562521a7a2564d41ab85434f4342505d/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.076849 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bfac90100e47ec858867a64c6c2846, user_id=562521a7a2564d41ab85434f4342505d, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:32.079537 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:32.224441 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1367/2750] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:32 2022] PUT /identity/v3/projects/50bfac90100e47ec858867a64c6c2846/users/562521a7a2564d41ab85434f4342505d/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:32.237250 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2d3db-92f6-44e7-a638-d4ab030840bf None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.237558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2d3db-92f6-44e7-a638-d4ab030840bf None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.237937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2d3db-92f6-44e7-a638-d4ab030840bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.256701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:32.263153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:32.273955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d0d2d3db-92f6-44e7-a638-d4ab030840bf None None] MFA Rules not processed for user `562521a7a2564d41ab85434f4342505d`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:32.275475 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d0d2d3db-92f6-44e7-a638-d4ab030840bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:32.304762 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:32.358005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1384/2751] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:32.360354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f69c66-142b-43a8-be82-35aeec884321 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:32.364197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2d3db-92f6-44e7-a638-d4ab030840bf None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:32.365301 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:32.365653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d0d2d3db-92f6-44e7-a638-d4ab030840bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:32.365971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.366250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.366518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] PATH_INFO: `/v3/projects/c75dbb545dd14bf2b3c9c6839e81f84e` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.367617 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75dbb545dd14bf2b3c9c6839e81f84e)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:32.369528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:32.425781 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2d3db-92f6-44e7-a638-d4ab030840bf None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:32.435215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cf229-3314-496e-9d51-2894d01ff067 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8070d1891844da59196d00ebbdff832', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:32.436212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cf229-3314-496e-9d51-2894d01ff067 service glance] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.436558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cf229-3314-496e-9d51-2894d01ff067 service glance] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.436844 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cf229-3314-496e-9d51-2894d01ff067 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.451693 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cf229-3314-496e-9d51-2894d01ff067 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:32.453766 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cf229-3314-496e-9d51-2894d01ff067 service glance] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:32.465868 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1385/2752] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:42:32.487523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75dbb545dd14bf2b3c9c6839e81f84e', 'request_id': 'req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:32.574382 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75dbb545dd14bf2b3c9c6839e81f84e', 'request_id': 'req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:32.582256 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75dbb545dd14bf2b3c9c6839e81f84e', 'request_id': 'req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:32.588480 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:32.595645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] The token cache is being invalidate because project c75dbb545dd14bf2b3c9c6839e81f84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:32.595938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:32.596631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3fa8f1f3-74fb-4191-83ae-033ce3bf9c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:32.601836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1368/2753] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:32 2022] DELETE /identity/v3/projects/c75dbb545dd14bf2b3c9c6839e81f84e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:32.604092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b89a-0765-4174-bb3a-682b7cabc406 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.604379 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b89a-0765-4174-bb3a-682b7cabc406 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.604750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b89a-0765-4174-bb3a-682b7cabc406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.625203 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-79d0b89a-0765-4174-bb3a-682b7cabc406 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:32.626467 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-79d0b89a-0765-4174-bb3a-682b7cabc406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:32.689584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1386/2754] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:32.698991 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1373-f1f9-45f7-9137-68f53ef40fd6 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.699264 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1373-f1f9-45f7-9137-68f53ef40fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.699539 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb1373-f1f9-45f7-9137-68f53ef40fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.722509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-39bb1373-f1f9-45f7-9137-68f53ef40fd6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:32.723715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-39bb1373-f1f9-45f7-9137-68f53ef40fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:32.732473 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1369/2755] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:32.736746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b89a-0765-4174-bb3a-682b7cabc406 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:32.750861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b89a-0765-4174-bb3a-682b7cabc406 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:32.751692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:32.752291 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.752573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.752845 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.753502 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:32.753819 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:32.755461 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:32.767634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1387/2756] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:32.772037 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb1373-f1f9-45f7-9137-68f53ef40fd6 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:32.781625 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb1373-f1f9-45f7-9137-68f53ef40fd6 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:32.786327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388a29-dfc8-48e8-bc2c-34ce19c8fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:32.786916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388a29-dfc8-48e8-bc2c-34ce19c8fbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.787195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388a29-dfc8-48e8-bc2c-34ce19c8fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.787465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388a29-dfc8-48e8-bc2c-34ce19c8fbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.788094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e388a29-dfc8-48e8-bc2c-34ce19c8fbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:32.790058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e388a29-dfc8-48e8-bc2c-34ce19c8fbc5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:32.912112 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1370/2757] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:32 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:32.916912 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:32.927055 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b180a-8ea1-4bb0-99ea-62f2dc09ecce admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:32.978406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=100 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:32.985228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ef83c-fc65-425f-962f-e65b5554392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:32.985854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef83c-fc65-425f-962f-e65b5554392b admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:32.986135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef83c-fc65-425f-962f-e65b5554392b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:32.986407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ef83c-fc65-425f-962f-e65b5554392b admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:32.987030 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ef83c-fc65-425f-962f-e65b5554392b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:32.988941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ef83c-fc65-425f-962f-e65b5554392b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:33.128457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1388/2758] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:32 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:33.132576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388a29-dfc8-48e8-bc2c-34ce19c8fbc5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:33.143705 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388a29-dfc8-48e8-bc2c-34ce19c8fbc5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:33.148455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c0dd-6dd9-4109-8219-05e516e5034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:33.149127 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c0dd-6dd9-4109-8219-05e516e5034e admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:33.149383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c0dd-6dd9-4109-8219-05e516e5034e admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:33.149684 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c0dd-6dd9-4109-8219-05e516e5034e admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:33.150330 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0c0dd-6dd9-4109-8219-05e516e5034e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:33.151993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0c0dd-6dd9-4109-8219-05e516e5034e admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:33.161985 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1371/2759] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:33.165963 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ef83c-fc65-425f-962f-e65b5554392b admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:33.175895 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ef83c-fc65-425f-962f-e65b5554392b admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:33.180564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2f84d-c96d-4bbc-ac7b-e420350c4c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:33.181156 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f84d-c96d-4bbc-ac7b-e420350c4c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:33.181437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f84d-c96d-4bbc-ac7b-e420350c4c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:33.181739 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2f84d-c96d-4bbc-ac7b-e420350c4c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:33.182380 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2f84d-c96d-4bbc-ac7b-e420350c4c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:33.184531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab2f84d-c96d-4bbc-ac7b-e420350c4c84 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:33.195157 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1389/2760] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:33.199837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c0dd-6dd9-4109-8219-05e516e5034e admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:33.209777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c0dd-6dd9-4109-8219-05e516e5034e admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:33.214577 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c94fd4-5a5d-414b-9319-c960a2bb3ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:33.215245 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94fd4-5a5d-414b-9319-c960a2bb3ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:33.215522 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94fd4-5a5d-414b-9319-c960a2bb3ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:33.215792 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c94fd4-5a5d-414b-9319-c960a2bb3ce8 admin admin] PATH_INFO: `/v3/projects/3609d98fccfa4f98870f441f3bec9ca8/users/9a12fb2ddff5486e806092733bf68eeb/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:33.229974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c94fd4-5a5d-414b-9319-c960a2bb3ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3609d98fccfa4f98870f441f3bec9ca8, user_id=9a12fb2ddff5486e806092733bf68eeb, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:33.232780 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c94fd4-5a5d-414b-9319-c960a2bb3ce8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:33.356994 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1372/2761] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:33 2022] PUT /identity/v3/projects/3609d98fccfa4f98870f441f3bec9ca8/users/9a12fb2ddff5486e806092733bf68eeb/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:33.367261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8e301-6dde-43ec-90e5-d3b0f1a9fcd9 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:33.367757 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8e301-6dde-43ec-90e5-d3b0f1a9fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:33.368037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8e301-6dde-43ec-90e5-d3b0f1a9fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:33.396472 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-acf8e301-6dde-43ec-90e5-d3b0f1a9fcd9 None None] MFA Rules not processed for user `9a12fb2ddff5486e806092733bf68eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:33.397721 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-acf8e301-6dde-43ec-90e5-d3b0f1a9fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:33.468346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1390/2762] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:33.472471 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c94fd4-5a5d-414b-9319-c960a2bb3ce8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:33.536492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c94fd4-5a5d-414b-9319-c960a2bb3ce8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:33.542701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77659ea7-4223-410f-9600-347681ffcb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:33.543590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659ea7-4223-410f-9600-347681ffcb9b admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:33.543590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659ea7-4223-410f-9600-347681ffcb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:33.543901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77659ea7-4223-410f-9600-347681ffcb9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:33.544511 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77659ea7-4223-410f-9600-347681ffcb9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:33.546623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77659ea7-4223-410f-9600-347681ffcb9b admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:33.635501 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1373/2763] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:33 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:33.636707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8e301-6dde-43ec-90e5-d3b0f1a9fcd9 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:33.647715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8e301-6dde-43ec-90e5-d3b0f1a9fcd9 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:33.707558 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022094a-e8af-4304-ad6e-7b2d07e4d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:33.708215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022094a-e8af-4304-ad6e-7b2d07e4d1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:33.708432 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022094a-e8af-4304-ad6e-7b2d07e4d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:33.708707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022094a-e8af-4304-ad6e-7b2d07e4d1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:33.709370 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022094a-e8af-4304-ad6e-7b2d07e4d1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:33.711336 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022094a-e8af-4304-ad6e-7b2d07e4d1b2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:33.791669 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1391/2764] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:33 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:33.796116 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77659ea7-4223-410f-9600-347681ffcb9b admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:33.809520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77659ea7-4223-410f-9600-347681ffcb9b admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:33.814391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741236-edd5-4806-be98-ede6922cecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:33.815138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741236-edd5-4806-be98-ede6922cecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:33.815422 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741236-edd5-4806-be98-ede6922cecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:33.815698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741236-edd5-4806-be98-ede6922cecd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:33.816347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90741236-edd5-4806-be98-ede6922cecd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:33.818114 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90741236-edd5-4806-be98-ede6922cecd7 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:33.828808 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1374/2765] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:33.835431 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022094a-e8af-4304-ad6e-7b2d07e4d1b2 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:33.848588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022094a-e8af-4304-ad6e-7b2d07e4d1b2 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:33.853428 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc558b8-5dd6-467b-9ec8-ff184a3db0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:33.854354 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc558b8-5dd6-467b-9ec8-ff184a3db0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:33.854524 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc558b8-5dd6-467b-9ec8-ff184a3db0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:33.855677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc558b8-5dd6-467b-9ec8-ff184a3db0d9 admin admin] PATH_INFO: `/v3/projects/0e31e6ce68e5463eb3577949d43c4a83/users/ee633b8cd9eb4cd2a4c7cba0bf0a2f35/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:33.871942 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc558b8-5dd6-467b-9ec8-ff184a3db0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e31e6ce68e5463eb3577949d43c4a83, user_id=ee633b8cd9eb4cd2a4c7cba0bf0a2f35, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:33.874692 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc558b8-5dd6-467b-9ec8-ff184a3db0d9 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:33.956112 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1392/2766] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:33 2022] PUT /identity/v3/projects/0e31e6ce68e5463eb3577949d43c4a83/users/ee633b8cd9eb4cd2a4c7cba0bf0a2f35/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:33.960516 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741236-edd5-4806-be98-ede6922cecd7 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:33.971157 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741236-edd5-4806-be98-ede6922cecd7 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:34.039138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38129bb0-0a43-47ed-8dc1-aedbf407ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:34.039759 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129bb0-0a43-47ed-8dc1-aedbf407ed46 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:34.040045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129bb0-0a43-47ed-8dc1-aedbf407ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:34.040318 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129bb0-0a43-47ed-8dc1-aedbf407ed46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:34.040992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38129bb0-0a43-47ed-8dc1-aedbf407ed46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:34.043242 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38129bb0-0a43-47ed-8dc1-aedbf407ed46 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:34.053810 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1375/2767] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:34.058940 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc558b8-5dd6-467b-9ec8-ff184a3db0d9 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:34.073371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc558b8-5dd6-467b-9ec8-ff184a3db0d9 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:34.080890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:34.080890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:34.080890 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:34.081267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] PATH_INFO: `/v3/projects/0e31e6ce68e5463eb3577949d43c4a83/users/ee633b8cd9eb4cd2a4c7cba0bf0a2f35/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:34.082925 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e31e6ce68e5463eb3577949d43c4a83, user_id=ee633b8cd9eb4cd2a4c7cba0bf0a2f35, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:34.085553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:34.097260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1393/2768] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:34 2022] PUT /identity/v3/projects/0e31e6ce68e5463eb3577949d43c4a83/users/ee633b8cd9eb4cd2a4c7cba0bf0a2f35/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:34.109901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a914b-5ac3-4600-a7c4-3666a54e4a5c None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:34.110172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a914b-5ac3-4600-a7c4-3666a54e4a5c None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:34.110521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a914b-5ac3-4600-a7c4-3666a54e4a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:34.118397 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:34.141765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-e05a914b-5ac3-4600-a7c4-3666a54e4a5c None None] MFA Rules not processed for user `ee633b8cd9eb4cd2a4c7cba0bf0a2f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:34.142971 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e05a914b-5ac3-4600-a7c4-3666a54e4a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:34.216180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1376/2769] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:34.226548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:34.228226 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:34.251304 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:34.290772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50f76b-ad12-4581-8e1e-c8eb37e3e620 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:34.295135 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369d621-f7e4-4b5c-964d-73d1e98667bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:34.295806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369d621-f7e4-4b5c-964d-73d1e98667bb service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:34.296099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369d621-f7e4-4b5c-964d-73d1e98667bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:34.296376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369d621-f7e4-4b5c-964d-73d1e98667bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:34.352508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369d621-f7e4-4b5c-964d-73d1e98667bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:34.353932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369d621-f7e4-4b5c-964d-73d1e98667bb service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:34.363418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1394/2770] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:35.594681 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a914b-5ac3-4600-a7c4-3666a54e4a5c None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:35.596263 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-e05a914b-5ac3-4600-a7c4-3666a54e4a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:35.661771 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a914b-5ac3-4600-a7c4-3666a54e4a5c None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:35.666267 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:35.666901 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:35.667860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:35.668178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] PATH_INFO: `/v3/users/e838d638bace4c1093ca5bb82d47d5d3` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:35.669255 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e838d638bace4c1093ca5bb82d47d5d3)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:35.671203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:35.850728 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e838d638bace4c1093ca5bb82d47d5d3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:35.858761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e838d638bace4c1093ca5bb82d47d5d3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:35.859481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e838d638bace4c1093ca5bb82d47d5d3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:35.860092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e838d638bace4c1093ca5bb82d47d5d3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:35.872655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e838d638bace4c1093ca5bb82d47d5d3'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:35.945366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1377/2771] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:35 2022] DELETE /identity/v3/users/e838d638bace4c1093ca5bb82d47d5d3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:35.950508 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c35d0c-e1e5-49f7-8408-195d8f6db833 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:35.951004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c35d0c-e1e5-49f7-8408-195d8f6db833 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:35.951124 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c35d0c-e1e5-49f7-8408-195d8f6db833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:35.971637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-37c35d0c-e1e5-49f7-8408-195d8f6db833 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:35.972843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-37c35d0c-e1e5-49f7-8408-195d8f6db833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:36.033827 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1395/2772] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:36.045141 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:36.046723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:36.059370 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:36.121466 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857116d0-33d7-4c24-9192-2d58cd0979da admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:36.125131 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fd72-ef3f-4c89-a918-727876e634fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:36.125767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fd72-ef3f-4c89-a918-727876e634fe service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:36.126055 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fd72-ef3f-4c89-a918-727876e634fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:36.126598 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0fd72-ef3f-4c89-a918-727876e634fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:36.136924 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0fd72-ef3f-4c89-a918-727876e634fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:36.138584 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0fd72-ef3f-4c89-a918-727876e634fe service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:36.149281 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1378/2773] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:36.821091 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c35d0c-e1e5-49f7-8408-195d8f6db833 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:36.822775 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-37c35d0c-e1e5-49f7-8408-195d8f6db833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:36.837699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c35d0c-e1e5-49f7-8408-195d8f6db833 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:36.844074 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:36.845012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:36.845450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:36.845886 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] PATH_INFO: `/v3/projects/69b6ce37f24343a69d229861b45a5c70` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:36.847609 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b6ce37f24343a69d229861b45a5c70)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:36.850745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:36.967114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b6ce37f24343a69d229861b45a5c70', 'request_id': 'req-780b122e-6990-4351-b9e1-a4dad9c3717f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:36.973193 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b6ce37f24343a69d229861b45a5c70', 'request_id': 'req-780b122e-6990-4351-b9e1-a4dad9c3717f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.069261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b6ce37f24343a69d229861b45a5c70', 'request_id': 'req-780b122e-6990-4351-b9e1-a4dad9c3717f'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.073812 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:37.081013 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] The token cache is being invalidate because project 69b6ce37f24343a69d229861b45a5c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:37.081300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.081968 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.083457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1396/2774] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:36 2022] DELETE /identity/v3/projects/69b6ce37f24343a69d229861b45a5c70 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:37.087702 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fd72-ef3f-4c89-a918-727876e634fe service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:37.097804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0fd72-ef3f-4c89-a918-727876e634fe service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:37.156900 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:37.157525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:37.157837 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:37.158110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] PATH_INFO: `/v3/users/9528c0c4cfe84e6a842806ae2d33a12f` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:37.159244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9528c0c4cfe84e6a842806ae2d33a12f)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:37.161321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:37.324663 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9528c0c4cfe84e6a842806ae2d33a12f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.331519 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9528c0c4cfe84e6a842806ae2d33a12f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.332250 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9528c0c4cfe84e6a842806ae2d33a12f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.332870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9528c0c4cfe84e6a842806ae2d33a12f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.345145 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-dffc4b61-b534-442b-922c-c1ed8e2ea61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9528c0c4cfe84e6a842806ae2d33a12f'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.436223 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1379/2775] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:37 2022] DELETE /identity/v3/users/9528c0c4cfe84e6a842806ae2d33a12f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:37.449661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:37.455795 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:37.470531 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b122e-6990-4351-b9e1-a4dad9c3717f admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:37.532882 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:37.533644 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:37.533936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:37.534220 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] PATH_INFO: `/v3/users/9a12fb2ddff5486e806092733bf68eeb` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:37.535674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a12fb2ddff5486e806092733bf68eeb)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:37.537736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:37.712714 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a12fb2ddff5486e806092733bf68eeb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.713372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a12fb2ddff5486e806092733bf68eeb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.714712 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a12fb2ddff5486e806092733bf68eeb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.813266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a12fb2ddff5486e806092733bf68eeb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.827063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a12fb2ddff5486e806092733bf68eeb'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:37.840539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1397/2776] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:37 2022] DELETE /identity/v3/users/9a12fb2ddff5486e806092733bf68eeb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:37.845038 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02b27-2f3b-4579-9013-c1787ea8b530 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:37.845329 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02b27-2f3b-4579-9013-c1787ea8b530 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:37.845627 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02b27-2f3b-4579-9013-c1787ea8b530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:37.862352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:37.863988 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:37.867680 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-ddb02b27-2f3b-4579-9013-c1787ea8b530 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:37.868897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ddb02b27-2f3b-4579-9013-c1787ea8b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:37.898431 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:37.932348 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1380/2777] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:37.938464 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94729cf7-9513-4a0c-9679-1b7d45d1ee9d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:37.942864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02b27-2f3b-4579-9013-c1787ea8b530 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:37.943218 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:37.945376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:37.945376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:37.945588 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-ddb02b27-2f3b-4579-9013-c1787ea8b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:37.945736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] PATH_INFO: `/v3/projects/b1353b429d7d46edb870ac17e13040c2` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:37.945834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1353b429d7d46edb870ac17e13040c2)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:37.947671 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:37.965779 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:38.004567 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02b27-2f3b-4579-9013-c1787ea8b530 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.008178 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba602ac-2b52-4a15-b14f-656c6a278cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.008777 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba602ac-2b52-4a15-b14f-656c6a278cfe service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.009058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba602ac-2b52-4a15-b14f-656c6a278cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.009331 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba602ac-2b52-4a15-b14f-656c6a278cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.019233 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba602ac-2b52-4a15-b14f-656c6a278cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.020689 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba602ac-2b52-4a15-b14f-656c6a278cfe service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:38.030129 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1381/2778] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:38.060592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1353b429d7d46edb870ac17e13040c2', 'request_id': 'req-cc499c9a-64c8-4619-9652-3c12f68a643e'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.067202 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1353b429d7d46edb870ac17e13040c2', 'request_id': 'req-cc499c9a-64c8-4619-9652-3c12f68a643e'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.178941 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1353b429d7d46edb870ac17e13040c2', 'request_id': 'req-cc499c9a-64c8-4619-9652-3c12f68a643e'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.190044 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] The token cache is being invalidate because project b1353b429d7d46edb870ac17e13040c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:38.190348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.190992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-cc499c9a-64c8-4619-9652-3c12f68a643e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.192505 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1398/2779] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:37 2022] DELETE /identity/v3/projects/b1353b429d7d46edb870ac17e13040c2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:38.197428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70712ee-f84b-4586-a7b2-76bd489517ca None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.197957 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70712ee-f84b-4586-a7b2-76bd489517ca None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.198065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70712ee-f84b-4586-a7b2-76bd489517ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.218482 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-d70712ee-f84b-4586-a7b2-76bd489517ca None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:38.219713 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d70712ee-f84b-4586-a7b2-76bd489517ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:38.287960 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1382/2780] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:38.296481 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ff13-e0a1-4346-a56d-b067759db785 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.296770 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ff13-e0a1-4346-a56d-b067759db785 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.297114 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ff13-e0a1-4346-a56d-b067759db785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.323677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1af8ff13-e0a1-4346-a56d-b067759db785 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:38.325004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1af8ff13-e0a1-4346-a56d-b067759db785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:38.333147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1399/2781] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:38.337524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70712ee-f84b-4586-a7b2-76bd489517ca None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:38.348214 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70712ee-f84b-4586-a7b2-76bd489517ca None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.353006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.353596 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.353916 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.354188 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.355413 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:38.355714 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.357306 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:38.368933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1383/2782] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:38.373993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8ff13-e0a1-4346-a56d-b067759db785 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:38.384364 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8ff13-e0a1-4346-a56d-b067759db785 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.389520 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cfeb0-9fd5-4b00-a3de-eb681989feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.390197 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cfeb0-9fd5-4b00-a3de-eb681989feff admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.390483 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cfeb0-9fd5-4b00-a3de-eb681989feff admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.390931 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17cfeb0-9fd5-4b00-a3de-eb681989feff admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.391578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cfeb0-9fd5-4b00-a3de-eb681989feff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.393500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17cfeb0-9fd5-4b00-a3de-eb681989feff admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:38.500874 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:38.502656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:38.519008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f3cf3-d7f8-4139-ad3a-1c497dce8b48 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.527122 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.527767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.528040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.528309 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] PATH_INFO: `/v3/projects/3609d98fccfa4f98870f441f3bec9ca8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.529542 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3609d98fccfa4f98870f441f3bec9ca8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.531493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:38.550347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1400/2783] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:38 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:38.551153 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cfeb0-9fd5-4b00-a3de-eb681989feff admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:38.614486 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17cfeb0-9fd5-4b00-a3de-eb681989feff admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.619176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42622ec9-e1f4-49cf-8483-ce2d92ab03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.619783 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622ec9-e1f4-49cf-8483-ce2d92ab03c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.620142 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622ec9-e1f4-49cf-8483-ce2d92ab03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.623456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622ec9-e1f4-49cf-8483-ce2d92ab03c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.623456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42622ec9-e1f4-49cf-8483-ce2d92ab03c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.623456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42622ec9-e1f4-49cf-8483-ce2d92ab03c3 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:38.664049 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3609d98fccfa4f98870f441f3bec9ca8', 'request_id': 'req-317f41f3-904c-4339-b094-5f827b82872c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.668208 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:38.733528 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1401/2784] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:38 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:38.737695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42622ec9-e1f4-49cf-8483-ce2d92ab03c3 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:38.747928 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42622ec9-e1f4-49cf-8483-ce2d92ab03c3 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.767580 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3609d98fccfa4f98870f441f3bec9ca8', 'request_id': 'req-317f41f3-904c-4339-b094-5f827b82872c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.775311 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3609d98fccfa4f98870f441f3bec9ca8', 'request_id': 'req-317f41f3-904c-4339-b094-5f827b82872c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.787892 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] The token cache is being invalidate because project 3609d98fccfa4f98870f441f3bec9ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:38.788227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.788941 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:38.790509 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1384/2785] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:38 2022] DELETE /identity/v3/projects/3609d98fccfa4f98870f441f3bec9ca8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:38.794541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:38.796111 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:38.811554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.812273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.812572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.812849 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.813495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.815144 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:38.820268 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:38.825979 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1402/2786] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:38.829784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:38.831473 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:38.844292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533d8bb-78e8-4e2f-95e5-c7d5318b7229 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.849992 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b27f1-515d-4dfe-903c-a41311bea07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.850751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b27f1-515d-4dfe-903c-a41311bea07c admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.851042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b27f1-515d-4dfe-903c-a41311bea07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.851319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b27f1-515d-4dfe-903c-a41311bea07c admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.852199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b27f1-515d-4dfe-903c-a41311bea07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.854212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b27f1-515d-4dfe-903c-a41311bea07c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:38.861571 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f41f3-904c-4339-b094-5f827b82872c admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.868460 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1403/2787] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:38.868602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.868602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.868602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.868602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] PATH_INFO: `/v3/users/ee633b8cd9eb4cd2a4c7cba0bf0a2f35` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.869323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee633b8cd9eb4cd2a4c7cba0bf0a2f35)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.869653 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b27f1-515d-4dfe-903c-a41311bea07c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:38.871244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:38.879377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b27f1-515d-4dfe-903c-a41311bea07c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:38.884229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae01ab5-664a-4382-b9f9-2bb9e1af84ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:38.884899 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01ab5-664a-4382-b9f9-2bb9e1af84ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:38.885437 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01ab5-664a-4382-b9f9-2bb9e1af84ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:38.886350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01ab5-664a-4382-b9f9-2bb9e1af84ad admin admin] PATH_INFO: `/v3/projects/a55f07379b9d4d68a2ca70e02a96e21b/users/097728b96afc4ffa8d501b9f3e0af737/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:38.903024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae01ab5-664a-4382-b9f9-2bb9e1af84ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55f07379b9d4d68a2ca70e02a96e21b, user_id=097728b96afc4ffa8d501b9f3e0af737, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:38.905297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae01ab5-664a-4382-b9f9-2bb9e1af84ad admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:39.014463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1404/2788] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:38 2022] PUT /identity/v3/projects/a55f07379b9d4d68a2ca70e02a96e21b/users/097728b96afc4ffa8d501b9f3e0af737/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:39.025937 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dda30-a3fa-4b0b-b727-0b344d1f42b5 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.026260 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dda30-a3fa-4b0b-b727-0b344d1f42b5 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.027041 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7dda30-a3fa-4b0b-b727-0b344d1f42b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.060146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-ce7dda30-a3fa-4b0b-b727-0b344d1f42b5 None None] MFA Rules not processed for user `097728b96afc4ffa8d501b9f3e0af737`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:39.062386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ce7dda30-a3fa-4b0b-b727-0b344d1f42b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:39.074097 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee633b8cd9eb4cd2a4c7cba0bf0a2f35'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.081390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee633b8cd9eb4cd2a4c7cba0bf0a2f35'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.082135 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee633b8cd9eb4cd2a4c7cba0bf0a2f35'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.082757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee633b8cd9eb4cd2a4c7cba0bf0a2f35'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.095243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee633b8cd9eb4cd2a4c7cba0bf0a2f35'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.129229 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1405/2789] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:39.133917 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dda30-a3fa-4b0b-b727-0b344d1f42b5 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:39.135478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ce7dda30-a3fa-4b0b-b727-0b344d1f42b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:39.162244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1385/2790] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:38 2022] DELETE /identity/v3/users/ee633b8cd9eb4cd2a4c7cba0bf0a2f35 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:39.203935 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7dda30-a3fa-4b0b-b727-0b344d1f42b5 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:39.266504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:39.267255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.267500 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.267774 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.268554 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:39.270523 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:39.276936 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:39.375923 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1406/2791] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:39 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:39.379835 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:39.390094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306166b-fe81-458b-b1a0-fdae0ca522b4 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:39.455933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a73c-5fa6-40bf-bade-670ca704baa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:39.456546 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a73c-5fa6-40bf-bade-670ca704baa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.456833 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a73c-5fa6-40bf-bade-670ca704baa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.457137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3a73c-5fa6-40bf-bade-670ca704baa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.458057 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3a73c-5fa6-40bf-bade-670ca704baa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:39.459822 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3a73c-5fa6-40bf-bade-670ca704baa1 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:39.469597 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:39.586192 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1386/2792] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:39 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:39.586876 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:39.588562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:39.590461 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a73c-5fa6-40bf-bade-670ca704baa1 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:39.600934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3a73c-5fa6-40bf-bade-670ca704baa1 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:39.601719 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326df7-9265-4742-9428-214d02d850a6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:39.606340 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:39.606976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.608184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.608184 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] PATH_INFO: `/v3/projects/0e31e6ce68e5463eb3577949d43c4a83` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.608616 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e31e6ce68e5463eb3577949d43c4a83)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:39.610674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:39.615102 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4f92-7ee1-4244-b345-6580294d78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:39.615962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4f92-7ee1-4244-b345-6580294d78c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.616241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4f92-7ee1-4244-b345-6580294d78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.616510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4f92-7ee1-4244-b345-6580294d78c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.617258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4f92-7ee1-4244-b345-6580294d78c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:39.618836 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4f92-7ee1-4244-b345-6580294d78c2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:39.629166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1387/2793] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:39.633650 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4f92-7ee1-4244-b345-6580294d78c2 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:39.645470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4f92-7ee1-4244-b345-6580294d78c2 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:39.650295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a34542-cbe0-4887-a24e-fdaccb3f314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:39.650953 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a34542-cbe0-4887-a24e-fdaccb3f314d admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.651793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a34542-cbe0-4887-a24e-fdaccb3f314d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.652079 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a34542-cbe0-4887-a24e-fdaccb3f314d admin admin] PATH_INFO: `/v3/projects/d04eb99cdbb341978eca17dff9d569fc/users/416d4215acb047d49f4636bb25b1430d/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.668602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a34542-cbe0-4887-a24e-fdaccb3f314d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04eb99cdbb341978eca17dff9d569fc, user_id=416d4215acb047d49f4636bb25b1430d, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:39.671257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a34542-cbe0-4887-a24e-fdaccb3f314d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:39.786455 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1388/2794] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:39 2022] PUT /identity/v3/projects/d04eb99cdbb341978eca17dff9d569fc/users/416d4215acb047d49f4636bb25b1430d/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:39.790451 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a34542-cbe0-4887-a24e-fdaccb3f314d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:39.797874 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e31e6ce68e5463eb3577949d43c4a83', 'request_id': 'req-74793901-b117-4c9e-9268-2b8cd2adbba2'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.804012 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e31e6ce68e5463eb3577949d43c4a83', 'request_id': 'req-74793901-b117-4c9e-9268-2b8cd2adbba2'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.852697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a34542-cbe0-4887-a24e-fdaccb3f314d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:39.869312 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e31e6ce68e5463eb3577949d43c4a83', 'request_id': 'req-74793901-b117-4c9e-9268-2b8cd2adbba2'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.882715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] The token cache is being invalidate because project 0e31e6ce68e5463eb3577949d43c4a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:39.883014 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.883817 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-74793901-b117-4c9e-9268-2b8cd2adbba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:39.886328 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1407/2795] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:39 2022] DELETE /identity/v3/projects/0e31e6ce68e5463eb3577949d43c4a83 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:39.890934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad065ed-229b-446e-abbe-6766d94d7ab7 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.891223 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad065ed-229b-446e-abbe-6766d94d7ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.896576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad065ed-229b-446e-abbe-6766d94d7ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.909573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a9247-0a9a-4c34-85cb-70a7f087acb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:39.910221 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a9247-0a9a-4c34-85cb-70a7f087acb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.910506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a9247-0a9a-4c34-85cb-70a7f087acb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.910862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-dad065ed-229b-446e-abbe-6766d94d7ab7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:39.910986 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a9247-0a9a-4c34-85cb-70a7f087acb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.911534 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a9247-0a9a-4c34-85cb-70a7f087acb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:39.912086 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dad065ed-229b-446e-abbe-6766d94d7ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:39.913438 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a9247-0a9a-4c34-85cb-70a7f087acb2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:39.920677 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1408/2796] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:39.933030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1389/2797] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:39.937534 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad065ed-229b-446e-abbe-6766d94d7ab7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:39.939020 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-dad065ed-229b-446e-abbe-6766d94d7ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:39.952225 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad065ed-229b-446e-abbe-6766d94d7ab7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:39.957262 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c198ef-0a5c-4304-8243-22ceb5708022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:39.958430 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c198ef-0a5c-4304-8243-22ceb5708022 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.958562 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c198ef-0a5c-4304-8243-22ceb5708022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.958748 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c198ef-0a5c-4304-8243-22ceb5708022 admin admin] PATH_INFO: `/v3/projects/d04eb99cdbb341978eca17dff9d569fc/users/416d4215acb047d49f4636bb25b1430d/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.960810 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c198ef-0a5c-4304-8243-22ceb5708022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04eb99cdbb341978eca17dff9d569fc, user_id=416d4215acb047d49f4636bb25b1430d, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:39.963582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c198ef-0a5c-4304-8243-22ceb5708022 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:39.976060 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1409/2798] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:39 2022] PUT /identity/v3/projects/d04eb99cdbb341978eca17dff9d569fc/users/416d4215acb047d49f4636bb25b1430d/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:39.986875 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac560d8-ff31-4351-b027-38163b5a07ad None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.987143 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca0cc-9979-4adf-8803-956ff5b102bd None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:39.987405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac560d8-ff31-4351-b027-38163b5a07ad None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.987500 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca0cc-9979-4adf-8803-956ff5b102bd None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:39.987604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac560d8-ff31-4351-b027-38163b5a07ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:39.987695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca0cc-9979-4adf-8803-956ff5b102bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.007837 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1ac560d8-ff31-4351-b027-38163b5a07ad None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:40.009056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1ac560d8-ff31-4351-b027-38163b5a07ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:40.017104 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-924ca0cc-9979-4adf-8803-956ff5b102bd None None] MFA Rules not processed for user `416d4215acb047d49f4636bb25b1430d`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:40.018304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-924ca0cc-9979-4adf-8803-956ff5b102bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:40.074905 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:40.079683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1410/2799] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:40.084042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac560d8-ff31-4351-b027-38163b5a07ad None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:40.093521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac560d8-ff31-4351-b027-38163b5a07ad None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:40.097940 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1390/2800] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:40.098212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:40.098863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.099150 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.099423 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.100100 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:40.100369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:40.102038 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:40.110456 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca0cc-9979-4adf-8803-956ff5b102bd None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:40.111894 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-924ca0cc-9979-4adf-8803-956ff5b102bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:40.114217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1411/2801] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:42:40.118572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:40.129549 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd68b0b-7d4b-429a-9573-5970d8f8dbcc admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:40.134341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed096a05-b9a2-40e9-a4c2-538571e2079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:40.134934 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed096a05-b9a2-40e9-a4c2-538571e2079b admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.135595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed096a05-b9a2-40e9-a4c2-538571e2079b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.136426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed096a05-b9a2-40e9-a4c2-538571e2079b admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.137075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed096a05-b9a2-40e9-a4c2-538571e2079b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:40.139104 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed096a05-b9a2-40e9-a4c2-538571e2079b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:40.176087 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca0cc-9979-4adf-8803-956ff5b102bd None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:40.179864 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b422f-5112-4c55-a58f-c30f100f4920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:40.180463 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b422f-5112-4c55-a58f-c30f100f4920 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.180739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b422f-5112-4c55-a58f-c30f100f4920 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.181009 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b422f-5112-4c55-a58f-c30f100f4920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.193504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b422f-5112-4c55-a58f-c30f100f4920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:40.193504 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b422f-5112-4c55-a58f-c30f100f4920 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:40.202738 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1391/2802] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:40.246683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1412/2803] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:40 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:40.247704 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b422f-5112-4c55-a58f-c30f100f4920 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:40.262206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b422f-5112-4c55-a58f-c30f100f4920 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:40.320523 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6359-d622-40a0-9348-956a67b61d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:40.321126 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6359-d622-40a0-9348-956a67b61d29 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.321414 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6359-d622-40a0-9348-956a67b61d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.321711 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6359-d622-40a0-9348-956a67b61d29 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.322334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6359-d622-40a0-9348-956a67b61d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:40.324730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6359-d622-40a0-9348-956a67b61d29 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:40.443056 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1392/2804] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:40 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:40.447403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed096a05-b9a2-40e9-a4c2-538571e2079b admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:40.458456 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed096a05-b9a2-40e9-a4c2-538571e2079b admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:40.463494 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ec1d6-a08e-4100-b044-c87f1e8bd91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:40.464750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ec1d6-a08e-4100-b044-c87f1e8bd91d admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.465032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ec1d6-a08e-4100-b044-c87f1e8bd91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.465353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ec1d6-a08e-4100-b044-c87f1e8bd91d admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.466024 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ec1d6-a08e-4100-b044-c87f1e8bd91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:40.467619 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ec1d6-a08e-4100-b044-c87f1e8bd91d admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:40.478107 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1413/2805] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:40.482307 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6359-d622-40a0-9348-956a67b61d29 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:40.493440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6359-d622-40a0-9348-956a67b61d29 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:40.499750 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be29d14-8fcb-447e-be48-7977c6a0e9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:40.500051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be29d14-8fcb-447e-be48-7977c6a0e9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.500341 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be29d14-8fcb-447e-be48-7977c6a0e9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.500611 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be29d14-8fcb-447e-be48-7977c6a0e9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.501265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be29d14-8fcb-447e-be48-7977c6a0e9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:40.502891 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be29d14-8fcb-447e-be48-7977c6a0e9b4 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:40.514134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1393/2806] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:40.518515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ec1d6-a08e-4100-b044-c87f1e8bd91d admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:40.524864 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:40.528637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ec1d6-a08e-4100-b044-c87f1e8bd91d admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:40.533337 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5db650-8f29-45d9-9c19-30bcc95f52e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:40.534019 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5db650-8f29-45d9-9c19-30bcc95f52e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.534300 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5db650-8f29-45d9-9c19-30bcc95f52e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.534572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5db650-8f29-45d9-9c19-30bcc95f52e3 admin admin] PATH_INFO: `/v3/projects/c3de179922de48c69c95c94ed6ee1fdb/users/234bc285022f476e8a07dbb33c46d61c/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.549713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5db650-8f29-45d9-9c19-30bcc95f52e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3de179922de48c69c95c94ed6ee1fdb, user_id=234bc285022f476e8a07dbb33c46d61c, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:40.561997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5db650-8f29-45d9-9c19-30bcc95f52e3 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:40.664034 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1414/2807] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:40 2022] PUT /identity/v3/projects/c3de179922de48c69c95c94ed6ee1fdb/users/234bc285022f476e8a07dbb33c46d61c/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:40.674676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f84a-aab5-4f8e-89cc-91b930faebd5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.674966 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f84a-aab5-4f8e-89cc-91b930faebd5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.675282 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f84a-aab5-4f8e-89cc-91b930faebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.704870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-bc92f84a-aab5-4f8e-89cc-91b930faebd5 None None] MFA Rules not processed for user `234bc285022f476e8a07dbb33c46d61c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:40.706032 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-bc92f84a-aab5-4f8e-89cc-91b930faebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:40.771569 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:40.780709 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1394/2808] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:40.791207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5db650-8f29-45d9-9c19-30bcc95f52e3 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:40.850960 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5db650-8f29-45d9-9c19-30bcc95f52e3 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:40.855326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2d609-fa9a-4a9c-be5b-d49e274abb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:40.855933 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d609-fa9a-4a9c-be5b-d49e274abb12 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:40.856216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d609-fa9a-4a9c-be5b-d49e274abb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:40.856496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2d609-fa9a-4a9c-be5b-d49e274abb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:40.864969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2d609-fa9a-4a9c-be5b-d49e274abb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:40.868222 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2d609-fa9a-4a9c-be5b-d49e274abb12 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:40.875409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1415/2809] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:41.175296 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f84a-aab5-4f8e-89cc-91b930faebd5 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:41.239566 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f84a-aab5-4f8e-89cc-91b930faebd5 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:41.244080 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416d4215acb047d49f4636bb25b1430d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd04eb99cdbb341978eca17dff9d569fc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:41.244683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:41.244968 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:41.245243 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:41.246172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:41.246310 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:41.247794 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:41.259249 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1395/2810] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:41.264310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2d609-fa9a-4a9c-be5b-d49e274abb12 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:41.275182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2d609-fa9a-4a9c-be5b-d49e274abb12 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:41.285957 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3695-e859-4d3d-aed2-c167e38daf47 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416d4215acb047d49f4636bb25b1430d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd04eb99cdbb341978eca17dff9d569fc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:41.286736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3695-e859-4d3d-aed2-c167e38daf47 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:41.287040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3695-e859-4d3d-aed2-c167e38daf47 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:41.287341 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3695-e859-4d3d-aed2-c167e38daf47 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:41.288007 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae3695-e859-4d3d-aed2-c167e38daf47 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:41.290000 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae3695-e859-4d3d-aed2-c167e38daf47 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:41.386485 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1416/2811] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:41 2022] POST /identity/v3/projects => generated 353 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:41.390555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:41.400444 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb7655-3f33-4d75-91ed-3138f9eb52fa tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:41.465253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416d4215acb047d49f4636bb25b1430d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd04eb99cdbb341978eca17dff9d569fc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:41.473044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:41.473044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:41.473044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:41.473044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:41.473044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:41.473517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:41.481133 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1396/2812] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:41.525463 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3695-e859-4d3d-aed2-c167e38daf47 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:41.534709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3695-e859-4d3d-aed2-c167e38daf47 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:41.539702 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416d4215acb047d49f4636bb25b1430d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd04eb99cdbb341978eca17dff9d569fc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:41.540325 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:41.541254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:41.541550 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] PATH_INFO: `/v3/projects/aec1a86d22e844a3b05d2890e91fb4b5` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:41.543420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aec1a86d22e844a3b05d2890e91fb4b5)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:41.545356 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:41.653168 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec1a86d22e844a3b05d2890e91fb4b5', 'request_id': 'req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:41.659784 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec1a86d22e844a3b05d2890e91fb4b5', 'request_id': 'req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:41.744832 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec1a86d22e844a3b05d2890e91fb4b5', 'request_id': 'req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:41.755887 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] The token cache is being invalidate because project aec1a86d22e844a3b05d2890e91fb4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:41.756181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:41.756826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-3a947962-9cb8-45e6-a78a-8676bd8d4fa3 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:41.758374 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1417/2813] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:41 2022] DELETE /identity/v3/projects/aec1a86d22e844a3b05d2890e91fb4b5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:42.393970 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:42.395697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:42.462730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0858f12-fc8a-42ac-9fbf-50767d8fe577 tempest-VolumeQuotaClassesTest-1153749927 tempest-VolumeQuotaClassesTest-1153749927-project-admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:42.491012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=100 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:42.519295 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:42.519934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:42.520216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:42.520493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] PATH_INFO: `/v3/users/097728b96afc4ffa8d501b9f3e0af737` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:42.521667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=097728b96afc4ffa8d501b9f3e0af737)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:42.523590 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:42.695459 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097728b96afc4ffa8d501b9f3e0af737'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:42.702297 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097728b96afc4ffa8d501b9f3e0af737'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:42.704389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097728b96afc4ffa8d501b9f3e0af737'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:42.704389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097728b96afc4ffa8d501b9f3e0af737'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:42.716180 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097728b96afc4ffa8d501b9f3e0af737'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:42.813877 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1397/2814] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:42 2022] DELETE /identity/v3/users/097728b96afc4ffa8d501b9f3e0af737 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:42.818376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62da7-33fa-48cb-a971-2c966310a539 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:42.818842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62da7-33fa-48cb-a971-2c966310a539 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:42.819071 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62da7-33fa-48cb-a971-2c966310a539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:42.838103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1da62da7-33fa-48cb-a971-2c966310a539 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:42.839822 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1da62da7-33fa-48cb-a971-2c966310a539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:42.884392 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:42.904547 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1418/2815] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:42.914433 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:42.915996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:43.017727 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccab0f4-ea53-471d-ae2f-9901d4cce376 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:43.023119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58637ff-c4ed-4948-bf49-aca996ca47c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:43.023119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58637ff-c4ed-4948-bf49-aca996ca47c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:43.023119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58637ff-c4ed-4948-bf49-aca996ca47c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:43.023119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58637ff-c4ed-4948-bf49-aca996ca47c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:43.032834 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58637ff-c4ed-4948-bf49-aca996ca47c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:43.034336 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58637ff-c4ed-4948-bf49-aca996ca47c3 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:43.044149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1398/2816] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:43.489834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da62da7-33fa-48cb-a971-2c966310a539 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:43.491294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1da62da7-33fa-48cb-a971-2c966310a539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:43.508269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da62da7-33fa-48cb-a971-2c966310a539 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:43.513885 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:43.514471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:43.514759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:43.515037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] PATH_INFO: `/v3/projects/a55f07379b9d4d68a2ca70e02a96e21b` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:43.516174 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55f07379b9d4d68a2ca70e02a96e21b)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:43.518276 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:43.622420 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55f07379b9d4d68a2ca70e02a96e21b', 'request_id': 'req-104800b2-40ce-44bc-87fb-7583517fffd8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:43.630032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55f07379b9d4d68a2ca70e02a96e21b', 'request_id': 'req-104800b2-40ce-44bc-87fb-7583517fffd8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:43.693204 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55f07379b9d4d68a2ca70e02a96e21b', 'request_id': 'req-104800b2-40ce-44bc-87fb-7583517fffd8'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:43.705433 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] The token cache is being invalidate because project a55f07379b9d4d68a2ca70e02a96e21b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:43.705759 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:43.706405 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:43.708298 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1419/2817] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:43 2022] DELETE /identity/v3/projects/a55f07379b9d4d68a2ca70e02a96e21b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:43.711876 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58637ff-c4ed-4948-bf49-aca996ca47c3 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:43.721764 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58637ff-c4ed-4948-bf49-aca996ca47c3 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:43.752529 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:43.779630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:43.780292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:43.780605 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:43.780878 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] PATH_INFO: `/v3/users/416d4215acb047d49f4636bb25b1430d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:43.782070 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416d4215acb047d49f4636bb25b1430d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:43.783974 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:43.986054 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416d4215acb047d49f4636bb25b1430d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:43.992739 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416d4215acb047d49f4636bb25b1430d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:43.993395 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416d4215acb047d49f4636bb25b1430d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:43.994073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416d4215acb047d49f4636bb25b1430d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:44.007391 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-54da1d7e-7df9-4634-8af7-50376018e1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416d4215acb047d49f4636bb25b1430d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:44.104799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1399/2818] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:43 2022] DELETE /identity/v3/users/416d4215acb047d49f4636bb25b1430d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:44.482713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:44.484255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:44.498907 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104800b2-40ce-44bc-87fb-7583517fffd8 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:44.557993 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:44.558626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:44.558906 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:44.559182 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] PATH_INFO: `/v3/projects/d04eb99cdbb341978eca17dff9d569fc` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:44.560330 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04eb99cdbb341978eca17dff9d569fc)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:44.562275 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:44.686811 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04eb99cdbb341978eca17dff9d569fc', 'request_id': 'req-40559633-ca75-45e3-ab31-d8e3bd1d30f0'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:44.693004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04eb99cdbb341978eca17dff9d569fc', 'request_id': 'req-40559633-ca75-45e3-ab31-d8e3bd1d30f0'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:44.772040 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04eb99cdbb341978eca17dff9d569fc', 'request_id': 'req-40559633-ca75-45e3-ab31-d8e3bd1d30f0'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:44.779326 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:44.783922 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] The token cache is being invalidate because project d04eb99cdbb341978eca17dff9d569fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:44.784212 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:44.784843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-40559633-ca75-45e3-ab31-d8e3bd1d30f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:44.786362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1420/2819] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:44 2022] DELETE /identity/v3/projects/d04eb99cdbb341978eca17dff9d569fc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:44.791253 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9b76-6124-41cb-afb9-531835b5aea0 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:44.791781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9b76-6124-41cb-afb9-531835b5aea0 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:44.791781 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9b76-6124-41cb-afb9-531835b5aea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:44.810797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-b14a9b76-6124-41cb-afb9-531835b5aea0 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:44.811992 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-b14a9b76-6124-41cb-afb9-531835b5aea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:44.870069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1400/2820] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:44.877842 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d2edd-2a43-4268-8153-912cb74def69 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:44.878137 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d2edd-2a43-4268-8153-912cb74def69 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:44.878417 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d2edd-2a43-4268-8153-912cb74def69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:44.898163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-1b8d2edd-2a43-4268-8153-912cb74def69 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:44.903495 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-1b8d2edd-2a43-4268-8153-912cb74def69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:44.907749 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1421/2821] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:44.912013 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a9b76-6124-41cb-afb9-531835b5aea0 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:44.922108 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a9b76-6124-41cb-afb9-531835b5aea0 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:44.926651 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:44.927246 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:44.927530 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:44.927806 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:44.928450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:44.928753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:44.930372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:44.942570 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1401/2822] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:42:44.946548 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d2edd-2a43-4268-8153-912cb74def69 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:44.955813 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d2edd-2a43-4268-8153-912cb74def69 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:44.960744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e28470-d6d3-47ec-b48d-c4a5f79753e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:44.961343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e28470-d6d3-47ec-b48d-c4a5f79753e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:44.961649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e28470-d6d3-47ec-b48d-c4a5f79753e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:44.961932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e28470-d6d3-47ec-b48d-c4a5f79753e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:44.962591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e28470-d6d3-47ec-b48d-c4a5f79753e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:44.964533 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e28470-d6d3-47ec-b48d-c4a5f79753e6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:44.999975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.001747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:45.015897 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723edb0-6a8c-453c-8d7e-e073bad1be5a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.021269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.022268 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.022636 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.023069 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] PATH_INFO: `/v3/users/234bc285022f476e8a07dbb33c46d61c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.024720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=234bc285022f476e8a07dbb33c46d61c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.027998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.055425 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1422/2823] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:44 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:45.056522 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e28470-d6d3-47ec-b48d-c4a5f79753e6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.119103 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e28470-d6d3-47ec-b48d-c4a5f79753e6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.123891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d1c9-1297-473a-bb8f-2fd0ac7a7235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.124490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d1c9-1297-473a-bb8f-2fd0ac7a7235 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.124771 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d1c9-1297-473a-bb8f-2fd0ac7a7235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.125048 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d1c9-1297-473a-bb8f-2fd0ac7a7235 admin admin] PATH_INFO: `/v3/users` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.125751 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d1c9-1297-473a-bb8f-2fd0ac7a7235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.129636 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d1c9-1297-473a-bb8f-2fd0ac7a7235 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.205302 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:45.206614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1423/2824] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:45 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:45.210427 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d1c9-1297-473a-bb8f-2fd0ac7a7235 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.215880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234bc285022f476e8a07dbb33c46d61c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:45.220764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d1c9-1297-473a-bb8f-2fd0ac7a7235 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.222907 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234bc285022f476e8a07dbb33c46d61c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:45.223592 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234bc285022f476e8a07dbb33c46d61c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:45.224886 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234bc285022f476e8a07dbb33c46d61c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:45.225782 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.226386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.226663 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.226945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.227599 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.229818 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.237203 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-7132044d-ce71-4718-b555-b6db2a938ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234bc285022f476e8a07dbb33c46d61c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:45.243584 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1424/2825] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:45.244694 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.246415 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:45.259163 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff37ca-d735-49a6-9fb3-86691c8319e1 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.264058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedba80-d1ed-4638-8228-4a1995304cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.264654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedba80-d1ed-4638-8228-4a1995304cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.264939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedba80-d1ed-4638-8228-4a1995304cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.265217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedba80-d1ed-4638-8228-4a1995304cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.265884 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedba80-d1ed-4638-8228-4a1995304cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.267617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afedba80-d1ed-4638-8228-4a1995304cb6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.281961 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1425/2826] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:45.282920 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedba80-d1ed-4638-8228-4a1995304cb6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.293790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedba80-d1ed-4638-8228-4a1995304cb6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.298614 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c41dc-245a-45c6-9cec-c483232fd7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.299292 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c41dc-245a-45c6-9cec-c483232fd7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.299573 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c41dc-245a-45c6-9cec-c483232fd7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.299896 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c41dc-245a-45c6-9cec-c483232fd7bc admin admin] PATH_INFO: `/v3/projects/56d64b3ee081422a94ef285d1a03d170/users/b41847b9e76f4af585f2a2982b9cba42/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.302701 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1402/2827] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:44 2022] DELETE /identity/v3/users/234bc285022f476e8a07dbb33c46d61c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:45.309003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b82b0-83a2-477f-84c5-e70e514dda39 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.309389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b82b0-83a2-477f-84c5-e70e514dda39 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.309766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b82b0-83a2-477f-84c5-e70e514dda39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.317806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c41dc-245a-45c6-9cec-c483232fd7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d64b3ee081422a94ef285d1a03d170, user_id=b41847b9e76f4af585f2a2982b9cba42, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.323161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c41dc-245a-45c6-9cec-c483232fd7bc admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.331030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-733b82b0-83a2-477f-84c5-e70e514dda39 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:45.332266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-733b82b0-83a2-477f-84c5-e70e514dda39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:45.393722 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1403/2828] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:45.402005 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1426/2829] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:45 2022] PUT /identity/v3/projects/56d64b3ee081422a94ef285d1a03d170/users/b41847b9e76f4af585f2a2982b9cba42/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:45.411712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b82b0-83a2-477f-84c5-e70e514dda39 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.411712 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-733b82b0-83a2-477f-84c5-e70e514dda39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:45.413916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d75789-c681-49d6-8793-84e24d148f9e None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.421835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d75789-c681-49d6-8793-84e24d148f9e None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.421835 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d75789-c681-49d6-8793-84e24d148f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.443972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-79d75789-c681-49d6-8793-84e24d148f9e None None] MFA Rules not processed for user `b41847b9e76f4af585f2a2982b9cba42`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:45.445181 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-79d75789-c681-49d6-8793-84e24d148f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:45.462106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b82b0-83a2-477f-84c5-e70e514dda39 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.509398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1427/2830] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:45.512034 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaa1cc-a30b-4d6f-9017-ae0818253829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.512498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaa1cc-a30b-4d6f-9017-ae0818253829 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.512774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaa1cc-a30b-4d6f-9017-ae0818253829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.513048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaa1cc-a30b-4d6f-9017-ae0818253829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.514824 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d75789-c681-49d6-8793-84e24d148f9e None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.519699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:45.536185 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:45.575146 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaa1cc-a30b-4d6f-9017-ae0818253829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.576593 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaa1cc-a30b-4d6f-9017-ae0818253829 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.577566 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d75789-c681-49d6-8793-84e24d148f9e None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.582246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e43c79-4aec-4043-8931-78e68eca1675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.582851 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43c79-4aec-4043-8931-78e68eca1675 admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.583130 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43c79-4aec-4043-8931-78e68eca1675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.583399 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e43c79-4aec-4043-8931-78e68eca1675 admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.584049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e43c79-4aec-4043-8931-78e68eca1675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.585969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e43c79-4aec-4043-8931-78e68eca1675 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.586312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1404/2831] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:45.683683 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1428/2832] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:45 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:45.687843 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaa1cc-a30b-4d6f-9017-ae0818253829 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.697439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaa1cc-a30b-4d6f-9017-ae0818253829 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.753785 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede6329-5435-4f48-ad86-cc80d34359b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.754390 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6329-5435-4f48-ad86-cc80d34359b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.754669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6329-5435-4f48-ad86-cc80d34359b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.754944 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede6329-5435-4f48-ad86-cc80d34359b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.755576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede6329-5435-4f48-ad86-cc80d34359b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.757486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede6329-5435-4f48-ad86-cc80d34359b6 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.865347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1405/2833] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:45 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:45.869285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e43c79-4aec-4043-8931-78e68eca1675 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.880412 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e43c79-4aec-4043-8931-78e68eca1675 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.886177 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a54b-bbbd-4064-951d-72f3355ec469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.886794 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a54b-bbbd-4064-951d-72f3355ec469 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.887076 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a54b-bbbd-4064-951d-72f3355ec469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.887347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a54b-bbbd-4064-951d-72f3355ec469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.887997 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a54b-bbbd-4064-951d-72f3355ec469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.889641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a54b-bbbd-4064-951d-72f3355ec469 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.901158 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1429/2834] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:45.906993 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede6329-5435-4f48-ad86-cc80d34359b6 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.918428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede6329-5435-4f48-ad86-cc80d34359b6 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.923881 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.925073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.925363 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.925666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.926320 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.927952 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:45.938776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1406/2835] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:45.943063 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a54b-bbbd-4064-951d-72f3355ec469 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:45.953016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a54b-bbbd-4064-951d-72f3355ec469 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:45.957893 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b40da-61bc-4618-939e-05398423f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:45.958539 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b40da-61bc-4618-939e-05398423f5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:45.958820 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b40da-61bc-4618-939e-05398423f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:45.959097 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b40da-61bc-4618-939e-05398423f5f5 admin admin] PATH_INFO: `/v3/projects/982cd915a18341928ac3e1a03f07be22/users/2a2188b88f7540c9b7ec44f254911d3d/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:45.974378 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b40da-61bc-4618-939e-05398423f5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982cd915a18341928ac3e1a03f07be22, user_id=2a2188b88f7540c9b7ec44f254911d3d, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:45.977095 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b40da-61bc-4618-939e-05398423f5f5 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:46.003847 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:46.005975 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:46.019824 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df68401-b879-4476-87a5-f799fcfb5712 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:46.024692 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:46.025352 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:46.025659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:46.028524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] PATH_INFO: `/v3/projects/c3de179922de48c69c95c94ed6ee1fdb` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:46.028524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3de179922de48c69c95c94ed6ee1fdb)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:46.033439 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:46.082192 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1430/2836] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:45 2022] PUT /identity/v3/projects/982cd915a18341928ac3e1a03f07be22/users/2a2188b88f7540c9b7ec44f254911d3d/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:46.092626 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54c03-a954-40a2-a5c0-62a4683f9b3f None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:46.092916 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54c03-a954-40a2-a5c0-62a4683f9b3f None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:46.093195 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f54c03-a954-40a2-a5c0-62a4683f9b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:46.120311 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d8f54c03-a954-40a2-a5c0-62a4683f9b3f None None] MFA Rules not processed for user `2a2188b88f7540c9b7ec44f254911d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:46.121504 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d8f54c03-a954-40a2-a5c0-62a4683f9b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:46.160510 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3de179922de48c69c95c94ed6ee1fdb', 'request_id': 'req-38ed6820-c5b3-42c6-8da3-01467ce7ab03'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:46.186998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1431/2837] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:46.191350 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54c03-a954-40a2-a5c0-62a4683f9b3f None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:46.243043 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:46.285049 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f54c03-a954-40a2-a5c0-62a4683f9b3f None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:46.325313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f358-bc5c-4940-b4c8-afa85db9fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:46.325313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f358-bc5c-4940-b4c8-afa85db9fc7c admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:46.325313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f358-bc5c-4940-b4c8-afa85db9fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:46.325313 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f358-bc5c-4940-b4c8-afa85db9fc7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:46.326173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f358-bc5c-4940-b4c8-afa85db9fc7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:46.326173 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f358-bc5c-4940-b4c8-afa85db9fc7c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:46.459152 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3de179922de48c69c95c94ed6ee1fdb', 'request_id': 'req-38ed6820-c5b3-42c6-8da3-01467ce7ab03'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:46.467200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3de179922de48c69c95c94ed6ee1fdb', 'request_id': 'req-38ed6820-c5b3-42c6-8da3-01467ce7ab03'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:46.478006 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] The token cache is being invalidate because project c3de179922de48c69c95c94ed6ee1fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:46.478304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:46.479005 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:46.480513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1407/2838] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:46 2022] DELETE /identity/v3/projects/c3de179922de48c69c95c94ed6ee1fdb => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:46.579067 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1432/2839] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:46 2022] POST /identity/v3/projects => generated 385 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:46.580448 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:46.581973 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:46.595797 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed6820-c5b3-42c6-8da3-01467ce7ab03 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:46.617016 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:46.667753 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1859-33c4-452f-9801-58f096b34f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:46.668385 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1859-33c4-452f-9801-58f096b34f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:46.668667 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1859-33c4-452f-9801-58f096b34f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:46.668934 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1859-33c4-452f-9801-58f096b34f86 admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:46.669581 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f1859-33c4-452f-9801-58f096b34f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:46.671675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f1859-33c4-452f-9801-58f096b34f86 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:46.831027 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1408/2840] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:46 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:42:46.835085 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f358-bc5c-4940-b4c8-afa85db9fc7c admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:46.845396 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f358-bc5c-4940-b4c8-afa85db9fc7c admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:46.850077 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4fbb-4f28-40bc-b921-3dd36dd8cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:46.851800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4fbb-4f28-40bc-b921-3dd36dd8cc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:46.851800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4fbb-4f28-40bc-b921-3dd36dd8cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:46.851800 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa4fbb-4f28-40bc-b921-3dd36dd8cc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:46.852113 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa4fbb-4f28-40bc-b921-3dd36dd8cc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:46.853711 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa4fbb-4f28-40bc-b921-3dd36dd8cc56 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:46.863668 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1433/2841] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:46.867839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1859-33c4-452f-9801-58f096b34f86 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:46.878227 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1859-33c4-452f-9801-58f096b34f86 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:46.882811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d4d-e66b-40d0-9b44-61e16a79c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:46.888042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d4d-e66b-40d0-9b44-61e16a79c546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:46.888042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d4d-e66b-40d0-9b44-61e16a79c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:46.888042 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff813d4d-e66b-40d0-9b44-61e16a79c546 admin admin] PATH_INFO: `/v3/projects/38a65f6856ee4212a7ff20eb0b56505c/users/0d3cbfacc2ae4458a76170e7b00a42d9/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:46.899450 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d4d-e66b-40d0-9b44-61e16a79c546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a65f6856ee4212a7ff20eb0b56505c, user_id=0d3cbfacc2ae4458a76170e7b00a42d9, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:46.902124 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff813d4d-e66b-40d0-9b44-61e16a79c546 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:46.967880 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1409/2842] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:46 2022] PUT /identity/v3/projects/38a65f6856ee4212a7ff20eb0b56505c/users/0d3cbfacc2ae4458a76170e7b00a42d9/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:46.972017 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4fbb-4f28-40bc-b921-3dd36dd8cc56 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:46.982605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa4fbb-4f28-40bc-b921-3dd36dd8cc56 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:47.039667 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bda5a-ac1a-47a2-a0e6-5b73d4129ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:47.040277 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bda5a-ac1a-47a2-a0e6-5b73d4129ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:47.040556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bda5a-ac1a-47a2-a0e6-5b73d4129ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:47.040829 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bda5a-ac1a-47a2-a0e6-5b73d4129ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:47.042056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bda5a-ac1a-47a2-a0e6-5b73d4129ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:47.043608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bda5a-ac1a-47a2-a0e6-5b73d4129ff1 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:47.053343 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1434/2843] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:47.058440 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d4d-e66b-40d0-9b44-61e16a79c546 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:47.069218 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff813d4d-e66b-40d0-9b44-61e16a79c546 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:47.074072 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:47.074770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:47.075052 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:47.075325 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] PATH_INFO: `/v3/projects/38a65f6856ee4212a7ff20eb0b56505c/users/0d3cbfacc2ae4458a76170e7b00a42d9/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:47.077258 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a65f6856ee4212a7ff20eb0b56505c, user_id=0d3cbfacc2ae4458a76170e7b00a42d9, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:47.079937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:47.090813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1410/2844] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:47 2022] PUT /identity/v3/projects/38a65f6856ee4212a7ff20eb0b56505c/users/0d3cbfacc2ae4458a76170e7b00a42d9/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:47.103750 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b0ab-530a-4ec5-bc1c-615180706e82 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:47.104572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b0ab-530a-4ec5-bc1c-615180706e82 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:47.104847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b0ab-530a-4ec5-bc1c-615180706e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:47.133938 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-4597b0ab-530a-4ec5-bc1c-615180706e82 None None] MFA Rules not processed for user `0d3cbfacc2ae4458a76170e7b00a42d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:47.136745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4597b0ab-530a-4ec5-bc1c-615180706e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:47.181797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:47.202998 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1435/2845] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:47.214137 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:47.215826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:47.296517 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91563f70-276c-4730-82ef-73ae4971f4a0 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:47.300244 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d66e56-65b0-4907-b9c4-1815e336b998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:47.300839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66e56-65b0-4907-b9c4-1815e336b998 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:47.301119 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66e56-65b0-4907-b9c4-1815e336b998 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:47.301452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66e56-65b0-4907-b9c4-1815e336b998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:47.310448 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d66e56-65b0-4907-b9c4-1815e336b998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:47.320312 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d66e56-65b0-4907-b9c4-1815e336b998 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:47.321048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1411/2846] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:48.654445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597b0ab-530a-4ec5-bc1c-615180706e82 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:48.655892 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4597b0ab-530a-4ec5-bc1c-615180706e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:48.668209 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597b0ab-530a-4ec5-bc1c-615180706e82 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:48.672376 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:48.684147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:48.684147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:48.684147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:48.684147 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:48.733617 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:48.735078 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:48.743846 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1436/2847] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:53.838676 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d66e56-65b0-4907-b9c4-1815e336b998 service cinder] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:53.847360 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d66e56-65b0-4907-b9c4-1815e336b998 service cinder] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:53.851040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc7f07-e733-4cca-9c55-a00933916094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:53.851630 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc7f07-e733-4cca-9c55-a00933916094 service cinder] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:53.851912 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc7f07-e733-4cca-9c55-a00933916094 service cinder] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:53.852186 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc7f07-e733-4cca-9c55-a00933916094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:53.854506 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-5ebc7f07-e733-4cca-9c55-a00933916094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:53.908798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:53.912048 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc7f07-e733-4cca-9c55-a00933916094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:53.913490 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc7f07-e733-4cca-9c55-a00933916094 service cinder] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:53.922793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1412/2848] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:56.778307 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:56.779764 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:56.844346 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d98b-c765-489a-bb38-baec0f523d05 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:56.848939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:56.849592 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:56.849954 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:56.850180 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] PATH_INFO: `/v3/users/562521a7a2564d41ab85434f4342505d` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:56.851357 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562521a7a2564d41ab85434f4342505d)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:56.853263 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:57.055285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562521a7a2564d41ab85434f4342505d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.055955 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562521a7a2564d41ab85434f4342505d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.057185 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562521a7a2564d41ab85434f4342505d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.109649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562521a7a2564d41ab85434f4342505d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.122408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562521a7a2564d41ab85434f4342505d'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.135515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1437/2849] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:56 2022] DELETE /identity/v3/users/562521a7a2564d41ab85434f4342505d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:57.140147 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2f38-f34c-43ac-948f-9d4b1804de66 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:57.140656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2f38-f34c-43ac-948f-9d4b1804de66 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:57.140774 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2f38-f34c-43ac-948f-9d4b1804de66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:57.160366 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-071a2f38-f34c-43ac-948f-9d4b1804de66 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:57.161548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-071a2f38-f34c-43ac-948f-9d4b1804de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:57.222308 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1413/2850] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:57.232546 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:57.234066 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:57.239457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:57.291646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768e0d2-d741-4259-bf7b-9729ca555e46 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:57.295410 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:57.296016 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:57.296297 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:57.296572 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:57.305567 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:57.307648 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:57.317604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1438/2851] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:57.753110 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a2f38-f34c-43ac-948f-9d4b1804de66 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:57.754623 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-071a2f38-f34c-43ac-948f-9d4b1804de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:57.767105 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a2f38-f34c-43ac-948f-9d4b1804de66 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:57.771862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:57.772514 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:57.772798 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:57.773075 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] PATH_INFO: `/v3/projects/50bfac90100e47ec858867a64c6c2846` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:57.774447 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50bfac90100e47ec858867a64c6c2846)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:57.776428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:57.885851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50bfac90100e47ec858867a64c6c2846', 'request_id': 'req-bed105bb-96b2-4457-a342-b7849685d556'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.886847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:57.888397 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:57.902407 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbca0cb-6075-459e-a87b-5ecc2a9c3aeb service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:57.944284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50bfac90100e47ec858867a64c6c2846', 'request_id': 'req-bed105bb-96b2-4457-a342-b7849685d556'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.951207 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50bfac90100e47ec858867a64c6c2846', 'request_id': 'req-bed105bb-96b2-4457-a342-b7849685d556'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.962409 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:57.963260 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] The token cache is being invalidate because project 50bfac90100e47ec858867a64c6c2846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:57.963554 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.963797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:57.964090 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:57.964206 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-bed105bb-96b2-4457-a342-b7849685d556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:57.964351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] PATH_INFO: `/v3/users/b41847b9e76f4af585f2a2982b9cba42` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:57.965496 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41847b9e76f4af585f2a2982b9cba42)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:57.965720 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1414/2852] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:57 2022] DELETE /identity/v3/projects/50bfac90100e47ec858867a64c6c2846 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:57.970691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18336593-c252-4503-8254-2484844d768d None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:57.971023 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:57.971166 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18336593-c252-4503-8254-2484844d768d None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:57.971305 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18336593-c252-4503-8254-2484844d768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:57.990555 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-18336593-c252-4503-8254-2484844d768d None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:57.991805 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-18336593-c252-4503-8254-2484844d768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:58.003150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1415/2853] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:58.008354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3dc0-1387-4727-af05-33f8e86580c2 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.008645 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3dc0-1387-4727-af05-33f8e86580c2 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.008926 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd3dc0-1387-4727-af05-33f8e86580c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.028505 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-38fd3dc0-1387-4727-af05-33f8e86580c2 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:58.029842 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-38fd3dc0-1387-4727-af05-33f8e86580c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:58.037866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1416/2854] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:58.042683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3dc0-1387-4727-af05-33f8e86580c2 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.054815 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd3dc0-1387-4727-af05-33f8e86580c2 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.060171 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.066493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.066493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.066493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.066493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:42:58.066493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.066493 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:58.076553 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1417/2855] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:42:58.080875 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.090923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ac57b-03d9-4be5-9d7d-8d29586b61b8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.100631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.100631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.100631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.100631 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.101044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.101044 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:58.191358 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41847b9e76f4af585f2a2982b9cba42'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:58.192027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41847b9e76f4af585f2a2982b9cba42'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:58.192635 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41847b9e76f4af585f2a2982b9cba42'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:58.241099 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1418/2856] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:42:58 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:58.245776 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.247349 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:58.257914 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41847b9e76f4af585f2a2982b9cba42'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:58.270806 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-1ad28c2a-2ee0-49ad-ace5-54bc4d130f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41847b9e76f4af585f2a2982b9cba42'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:58.277899 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:58.284521 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1439/2857] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:57 2022] DELETE /identity/v3/users/b41847b9e76f4af585f2a2982b9cba42 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:42:58.288872 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b811-1701-4aee-9351-1a9333a4c4c7 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.289234 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b811-1701-4aee-9351-1a9333a4c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.289514 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441b811-1701-4aee-9351-1a9333a4c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.309861 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d441b811-1701-4aee-9351-1a9333a4c4c7 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:58.311056 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d441b811-1701-4aee-9351-1a9333a4c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:58.312092 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dcf8-35d8-4a83-8877-6fb89451f5e8 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.335408 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:58.373932 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12bebc-48c0-423f-9889-f032c62c7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.374698 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12bebc-48c0-423f-9889-f032c62c7dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.375653 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12bebc-48c0-423f-9889-f032c62c7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.375933 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12bebc-48c0-423f-9889-f032c62c7dcc admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.376573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12bebc-48c0-423f-9889-f032c62c7dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.376678 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1440/2858] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:42:58.378536 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12bebc-48c0-423f-9889-f032c62c7dcc admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:58.386715 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441b811-1701-4aee-9351-1a9333a4c4c7 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.388082 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d441b811-1701-4aee-9351-1a9333a4c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:58.445744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441b811-1701-4aee-9351-1a9333a4c4c7 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.450680 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097160-b0e2-428b-8413-99758bcd1a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.451294 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097160-b0e2-428b-8413-99758bcd1a68 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.451577 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097160-b0e2-428b-8413-99758bcd1a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.451854 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097160-b0e2-428b-8413-99758bcd1a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.453226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1419/2859] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:42:58 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:42:58.457046 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12bebc-48c0-423f-9889-f032c62c7dcc admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.461465 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c097160-b0e2-428b-8413-99758bcd1a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.463004 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c097160-b0e2-428b-8413-99758bcd1a68 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:58.466494 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12bebc-48c0-423f-9889-f032c62c7dcc admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.471404 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecfa82-76b1-4878-a6d6-b870eef16c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.471996 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfa82-76b1-4878-a6d6-b870eef16c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.472279 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfa82-76b1-4878-a6d6-b870eef16c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.472556 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecfa82-76b1-4878-a6d6-b870eef16c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.472953 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1441/2860] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:58.479763 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecfa82-76b1-4878-a6d6-b870eef16c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.481748 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecfa82-76b1-4878-a6d6-b870eef16c9f admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:58.492149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1420/2861] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:42:58.496543 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097160-b0e2-428b-8413-99758bcd1a68 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.506254 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c097160-b0e2-428b-8413-99758bcd1a68 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.511377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359c848-b010-45c8-8ecc-f534a8025907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.511918 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c848-b010-45c8-8ecc-f534a8025907 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.512199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c848-b010-45c8-8ecc-f534a8025907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.512474 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359c848-b010-45c8-8ecc-f534a8025907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.513259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359c848-b010-45c8-8ecc-f534a8025907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.514903 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359c848-b010-45c8-8ecc-f534a8025907 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:58.528101 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1442/2862] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:42:58.529266 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecfa82-76b1-4878-a6d6-b870eef16c9f admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.540269 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecfa82-76b1-4878-a6d6-b870eef16c9f admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.545863 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866877e7-0536-4088-8c84-44abf2b30360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.546659 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866877e7-0536-4088-8c84-44abf2b30360 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.546943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866877e7-0536-4088-8c84-44abf2b30360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.547226 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866877e7-0536-4088-8c84-44abf2b30360 admin admin] PATH_INFO: `/v3/projects/3545dec5afb04144bfcdf9919a9f7747/users/0724c1d3b38c47d881fa27dc3937ca8c/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.563156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866877e7-0536-4088-8c84-44abf2b30360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3545dec5afb04144bfcdf9919a9f7747, user_id=0724c1d3b38c47d881fa27dc3937ca8c, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.565853 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866877e7-0536-4088-8c84-44abf2b30360 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:58.658383 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1421/2863] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:42:58 2022] PUT /identity/v3/projects/3545dec5afb04144bfcdf9919a9f7747/users/0724c1d3b38c47d881fa27dc3937ca8c/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:58.663371 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4a449-d65f-47af-830b-08ee4648bcd6 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.663744 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4a449-d65f-47af-830b-08ee4648bcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.664087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4a449-d65f-47af-830b-08ee4648bcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.683915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-d3c4a449-d65f-47af-830b-08ee4648bcd6 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:42:58.685123 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d3c4a449-d65f-47af-830b-08ee4648bcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:58.748352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1443/2864] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:42:58.758257 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866877e7-0536-4088-8c84-44abf2b30360 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.815086 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866877e7-0536-4088-8c84-44abf2b30360 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.818717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625840bb-782a-4d15-832b-0b737ecadb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.819326 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625840bb-782a-4d15-832b-0b737ecadb13 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.819607 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625840bb-782a-4d15-832b-0b737ecadb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.819879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625840bb-782a-4d15-832b-0b737ecadb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.829204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625840bb-782a-4d15-832b-0b737ecadb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.830675 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625840bb-782a-4d15-832b-0b737ecadb13 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:58.840496 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1422/2865] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:42:58.928414 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4a449-d65f-47af-830b-08ee4648bcd6 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:58.932099 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-d3c4a449-d65f-47af-830b-08ee4648bcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:42:58.943455 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4a449-d65f-47af-830b-08ee4648bcd6 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:58.948945 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:58.950634 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:58.951027 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:58.951178 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] PATH_INFO: `/v3/projects/56d64b3ee081422a94ef285d1a03d170` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:58.952406 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d64b3ee081422a94ef285d1a03d170)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:58.954999 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:59.105293 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d64b3ee081422a94ef285d1a03d170', 'request_id': 'req-aab70aa5-771c-41a8-820b-e29e5f2b4c35'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.107207 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:59.111590 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d64b3ee081422a94ef285d1a03d170', 'request_id': 'req-aab70aa5-771c-41a8-820b-e29e5f2b4c35'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.218503 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d64b3ee081422a94ef285d1a03d170', 'request_id': 'req-aab70aa5-771c-41a8-820b-e29e5f2b4c35'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.232075 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] The token cache is being invalidate because project 56d64b3ee081422a94ef285d1a03d170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:42:59.232445 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.233246 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.235362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1444/2866] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:42:58 2022] DELETE /identity/v3/projects/56d64b3ee081422a94ef285d1a03d170 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:42:59.239304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625840bb-782a-4d15-832b-0b737ecadb13 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:42:59.250821 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625840bb-782a-4d15-832b-0b737ecadb13 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:42:59.281999 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:59.312674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:42:59.312674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:42:59.312674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:42:59.312674 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] PATH_INFO: `/v3/users/2a2188b88f7540c9b7ec44f254911d3d` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:42:59.313321 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2188b88f7540c9b7ec44f254911d3d)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:42:59.315002 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:42:59.541687 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2188b88f7540c9b7ec44f254911d3d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.548568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2188b88f7540c9b7ec44f254911d3d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.549334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2188b88f7540c9b7ec44f254911d3d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.549976 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2188b88f7540c9b7ec44f254911d3d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.562150 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2188b88f7540c9b7ec44f254911d3d'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:42:59.646851 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1423/2867] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:42:59 2022] DELETE /identity/v3/users/2a2188b88f7540c9b7ec44f254911d3d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:43:00.066092 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:00.067746 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:00.086319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab70aa5-771c-41a8-820b-e29e5f2b4c35 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:00.150314 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:00.150958 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:00.151240 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:00.151517 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] PATH_INFO: `/v3/projects/982cd915a18341928ac3e1a03f07be22` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:00.152655 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=982cd915a18341928ac3e1a03f07be22)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:00.154605 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:00.270696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982cd915a18341928ac3e1a03f07be22', 'request_id': 'req-5dfef392-464c-42df-8671-b9269c24a149'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.277858 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982cd915a18341928ac3e1a03f07be22', 'request_id': 'req-5dfef392-464c-42df-8671-b9269c24a149'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.342873 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982cd915a18341928ac3e1a03f07be22', 'request_id': 'req-5dfef392-464c-42df-8671-b9269c24a149'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.355709 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] The token cache is being invalidate because project 982cd915a18341928ac3e1a03f07be22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:43:00.356002 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.356654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.358199 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1445/2868] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:43:00 2022] DELETE /identity/v3/projects/982cd915a18341928ac3e1a03f07be22 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:43:00.362161 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:00.363697 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:00.376229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284ed0-3ac3-4853-8118-a1ec3fc8cc24 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:00.437394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:00.438076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:00.446204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:00.446204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] PATH_INFO: `/v3/users/0d3cbfacc2ae4458a76170e7b00a42d9` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:00.446204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3cbfacc2ae4458a76170e7b00a42d9)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:00.446204 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:00.636729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3cbfacc2ae4458a76170e7b00a42d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.643303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:00.650766 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3cbfacc2ae4458a76170e7b00a42d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.651513 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3cbfacc2ae4458a76170e7b00a42d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.652149 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3cbfacc2ae4458a76170e7b00a42d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.670234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-3f80e7fb-8c95-40a8-a0d5-24697698ebdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3cbfacc2ae4458a76170e7b00a42d9'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:00.772862 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1424/2869] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:43:00 2022] DELETE /identity/v3/users/0d3cbfacc2ae4458a76170e7b00a42d9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:43:01.328556 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:01.330217 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:01.345352 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfef392-464c-42df-8671-b9269c24a149 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:01.421450 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:01.422176 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:01.422453 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:01.422726 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] PATH_INFO: `/v3/projects/38a65f6856ee4212a7ff20eb0b56505c` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:01.423840 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a65f6856ee4212a7ff20eb0b56505c)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:01.425779 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:01.437143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:01.562737 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a65f6856ee4212a7ff20eb0b56505c', 'request_id': 'req-6dbfbd61-2a77-4362-8474-b9f26eb6b201'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:01.569452 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a65f6856ee4212a7ff20eb0b56505c', 'request_id': 'req-6dbfbd61-2a77-4362-8474-b9f26eb6b201'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:01.641426 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a65f6856ee4212a7ff20eb0b56505c', 'request_id': 'req-6dbfbd61-2a77-4362-8474-b9f26eb6b201'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:01.655309 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] The token cache is being invalidate because project 38a65f6856ee4212a7ff20eb0b56505c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:43:01.655604 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:01.656267 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-6dbfbd61-2a77-4362-8474-b9f26eb6b201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:01.658061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1446/2870] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:43:01 2022] DELETE /identity/v3/projects/38a65f6856ee4212a7ff20eb0b56505c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:43:01.665717 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394325-5db5-4ee4-896e-0e6438803928 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:01.666740 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394325-5db5-4ee4-896e-0e6438803928 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:01.670558 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394325-5db5-4ee4-896e-0e6438803928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:01.693767 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-41394325-5db5-4ee4-896e-0e6438803928 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:01.695003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-41394325-5db5-4ee4-896e-0e6438803928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:01.771725 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1425/2871] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:01.781087 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94161-76c3-4c4c-bbed-075df0a02314 None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:01.781317 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94161-76c3-4c4c-bbed-075df0a02314 None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:01.781595 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd94161-76c3-4c4c-bbed-075df0a02314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:01.813803 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-acd94161-76c3-4c4c-bbed-075df0a02314 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:01.816117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-acd94161-76c3-4c4c-bbed-075df0a02314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:01.827461 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1447/2872] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:01.832053 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41394325-5db5-4ee4-896e-0e6438803928 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:01.851304 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41394325-5db5-4ee4-896e-0e6438803928 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:01.861168 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:01.864212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:01.864212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:01.864212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:01.864212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81509) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:43:01.864212 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:01.864860 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:01.893532 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd94161-76c3-4c4c-bbed-075df0a02314 None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:01.894678 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1426/2873] 10.222.0.61 () {58 vars in 1153 bytes} [Tue Aug 23 16:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:43:01.905351 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd94161-76c3-4c4c-bbed-075df0a02314 None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:01.911183 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1c43-186c-4beb-a5e6-374c86c61cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:01.911929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1c43-186c-4beb-a5e6-374c86c61cca admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:01.912273 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1c43-186c-4beb-a5e6-374c86c61cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:01.912649 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1c43-186c-4beb-a5e6-374c86c61cca admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:01.913545 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e1c43-186c-4beb-a5e6-374c86c61cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:01.915989 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e1c43-186c-4beb-a5e6-374c86c61cca admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:02.020670 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1448/2874] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:43:01 2022] POST /identity/v3/projects => generated 397 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:43:02.025322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:02.037548 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7c284-5ad6-409f-b053-95a848b79ec9 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:02.100729 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab2e9f-0e90-4dfb-8a07-ae5a9ff192ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:02.101347 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2e9f-0e90-4dfb-8a07-ae5a9ff192ec admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:02.101655 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2e9f-0e90-4dfb-8a07-ae5a9ff192ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:02.102022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab2e9f-0e90-4dfb-8a07-ae5a9ff192ec admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:02.102670 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab2e9f-0e90-4dfb-8a07-ae5a9ff192ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:02.105262 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab2e9f-0e90-4dfb-8a07-ae5a9ff192ec admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:02.193586 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1427/2875] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:43:02 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:43:02.198902 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1c43-186c-4beb-a5e6-374c86c61cca admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:02.216908 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1c43-186c-4beb-a5e6-374c86c61cca admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:02.218232 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a44b0-b2f6-44d5-bd2b-5faf3e7f8e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:02.218797 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a44b0-b2f6-44d5-bd2b-5faf3e7f8e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:02.219536 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a44b0-b2f6-44d5-bd2b-5faf3e7f8e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:02.219778 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a44b0-b2f6-44d5-bd2b-5faf3e7f8e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:02.220674 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a44b0-b2f6-44d5-bd2b-5faf3e7f8e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:02.222972 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a44b0-b2f6-44d5-bd2b-5faf3e7f8e70 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:02.243457 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1449/2876] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:43:02.244708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab2e9f-0e90-4dfb-8a07-ae5a9ff192ec admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:02.260715 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab2e9f-0e90-4dfb-8a07-ae5a9ff192ec admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:02.265656 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba735d-6df2-474d-9765-585799c9f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:02.269167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba735d-6df2-474d-9765-585799c9f394 admin admin] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:02.269167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba735d-6df2-474d-9765-585799c9f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:02.269167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba735d-6df2-474d-9765-585799c9f394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:02.269167 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba735d-6df2-474d-9765-585799c9f394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:02.269765 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba735d-6df2-474d-9765-585799c9f394 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:02.285845 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1428/2877] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:43:02.290244 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a44b0-b2f6-44d5-bd2b-5faf3e7f8e70 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:02.303951 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a44b0-b2f6-44d5-bd2b-5faf3e7f8e70 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:02.310695 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:02.312529 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:02.312973 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:02.314353 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] PATH_INFO: `/v3/projects/e739f7965f71483e82a394779d99b8d1/users/834b013cefda41b7bde80c4b1b358841/roles/c2202fa3e5ce4430b5c100bfd6c74f21` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:02.334526 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e739f7965f71483e82a394779d99b8d1, user_id=834b013cefda41b7bde80c4b1b358841, role_id=c2202fa3e5ce4430b5c100bfd6c74f21)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:02.340162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:02.434215 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1450/2878] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:43:02 2022] PUT /identity/v3/projects/e739f7965f71483e82a394779d99b8d1/users/834b013cefda41b7bde80c4b1b358841/roles/c2202fa3e5ce4430b5c100bfd6c74f21 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:43:02.446200 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4da2-426a-4a4d-b8f2-e1ef4c2c70a5 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:02.446518 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4da2-426a-4a4d-b8f2-e1ef4c2c70a5 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:02.446791 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb4da2-426a-4a4d-b8f2-e1ef4c2c70a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:02.485153 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-91fb4da2-426a-4a4d-b8f2-e1ef4c2c70a5 None None] MFA Rules not processed for user `834b013cefda41b7bde80c4b1b358841`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:02.486492 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-91fb4da2-426a-4a4d-b8f2-e1ef4c2c70a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:02.537377 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:02.594458 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1429/2879] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:02.609699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:02.611859 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:02.684661 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45673-0334-48e8-8969-72ecc8512aa6 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:02.690118 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a81f47e4b004716bf54175c55606d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:02.691646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:02.691646 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:02.692068 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:02.702398 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:02.704419 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:02.715688 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1451/2880] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:43:04.535411 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1dee-a5fc-4e10-a0b2-50e8b4cc2f74 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:04.537394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1dee-a5fc-4e10-a0b2-50e8b4cc2f74 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:04.537394 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d1dee-a5fc-4e10-a0b2-50e8b4cc2f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:04.563761 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-758d1dee-a5fc-4e10-a0b2-50e8b4cc2f74 None None] MFA Rules not processed for user `0724c1d3b38c47d881fa27dc3937ca8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:04.565004 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-758d1dee-a5fc-4e10-a0b2-50e8b4cc2f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:04.627920 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1430/2881] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:43:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:04.632413 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:04.633929 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:04.680018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:04.702769 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56326c-3412-4b38-a586-36796a17abc5 service cinder] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:04.707538 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a2cae-1210-4200-85d4-6842849589be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:04.708334 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2cae-1210-4200-85d4-6842849589be admin admin] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:04.708444 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2cae-1210-4200-85d4-6842849589be admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:04.708682 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a2cae-1210-4200-85d4-6842849589be admin admin] PATH_INFO: `/v3/projects` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:04.709718 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a2cae-1210-4200-85d4-6842849589be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:04.712366 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a2cae-1210-4200-85d4-6842849589be admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:04.798863 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1452/2882] 10.222.0.61 () {60 vars in 1153 bytes} [Tue Aug 23 16:43:04 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:43:04.802706 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d1dee-a5fc-4e10-a0b2-50e8b4cc2f74 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:04.813380 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d1dee-a5fc-4e10-a0b2-50e8b4cc2f74 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:04.884470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd067ddc-4947-4315-a5a7-be43f215455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:04.885757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd067ddc-4947-4315-a5a7-be43f215455a admin admin] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:04.885757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd067ddc-4947-4315-a5a7-be43f215455a admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:04.886210 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd067ddc-4947-4315-a5a7-be43f215455a admin admin] PATH_INFO: `/v3/users` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:04.886541 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd067ddc-4947-4315-a5a7-be43f215455a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:04.888452 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd067ddc-4947-4315-a5a7-be43f215455a admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:05.028804 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1431/2883] 10.222.0.61 () {60 vars in 1144 bytes} [Tue Aug 23 16:43:04 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:43:05.033026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a2cae-1210-4200-85d4-6842849589be admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:05.043869 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a2cae-1210-4200-85d4-6842849589be admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:05.048535 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf227a-d69f-4265-bdcf-d7c8c4e98436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:05.049172 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf227a-d69f-4265-bdcf-d7c8c4e98436 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:05.049403 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf227a-d69f-4265-bdcf-d7c8c4e98436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:05.049707 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf227a-d69f-4265-bdcf-d7c8c4e98436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:05.050404 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf227a-d69f-4265-bdcf-d7c8c4e98436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:05.052018 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf227a-d69f-4265-bdcf-d7c8c4e98436 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:05.064058 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1453/2884] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:43:05.068351 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd067ddc-4947-4315-a5a7-be43f215455a admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:05.079014 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd067ddc-4947-4315-a5a7-be43f215455a admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:05.083641 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c8505-a7d4-4431-ad7b-56be55f42226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:05.084287 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8505-a7d4-4431-ad7b-56be55f42226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:05.084565 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8505-a7d4-4431-ad7b-56be55f42226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:05.084879 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8505-a7d4-4431-ad7b-56be55f42226 admin admin] PATH_INFO: `/v3/projects/8a2636e064614a3c939069ecf4f02bd6/users/be29b551676a4137b2f428f190860bd8/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:05.106012 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c8505-a7d4-4431-ad7b-56be55f42226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2636e064614a3c939069ecf4f02bd6, user_id=be29b551676a4137b2f428f190860bd8, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:05.109051 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c8505-a7d4-4431-ad7b-56be55f42226 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:05.233172 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1432/2885] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:43:05 2022] PUT /identity/v3/projects/8a2636e064614a3c939069ecf4f02bd6/users/be29b551676a4137b2f428f190860bd8/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:43:05.238377 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf227a-d69f-4265-bdcf-d7c8c4e98436 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:05.253576 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf227a-d69f-4265-bdcf-d7c8c4e98436 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:05.319362 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ab78-cdfd-43f0-b4d8-9461f8e55911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:05.319879 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ab78-cdfd-43f0-b4d8-9461f8e55911 admin admin] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:05.320162 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ab78-cdfd-43f0-b4d8-9461f8e55911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:05.320439 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ab78-cdfd-43f0-b4d8-9461f8e55911 admin admin] PATH_INFO: `/v3/roles` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:05.321080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430ab78-cdfd-43f0-b4d8-9461f8e55911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:05.322777 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430ab78-cdfd-43f0-b4d8-9461f8e55911 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:05.333664 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1454/2886] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 16:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:43:05.338396 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c8505-a7d4-4431-ad7b-56be55f42226 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:05.348666 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c8505-a7d4-4431-ad7b-56be55f42226 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:05.353858 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde841-4d97-430b-bc23-276e45cb9581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:05.354512 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde841-4d97-430b-bc23-276e45cb9581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:05.354795 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde841-4d97-430b-bc23-276e45cb9581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:05.355068 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde841-4d97-430b-bc23-276e45cb9581 admin admin] PATH_INFO: `/v3/projects/8a2636e064614a3c939069ecf4f02bd6/users/be29b551676a4137b2f428f190860bd8/roles/896aa4932a1a46dabc0e1036ad2f44de` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:05.356995 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde841-4d97-430b-bc23-276e45cb9581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2636e064614a3c939069ecf4f02bd6, user_id=be29b551676a4137b2f428f190860bd8, role_id=896aa4932a1a46dabc0e1036ad2f44de)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:05.359669 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde841-4d97-430b-bc23-276e45cb9581 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:05.370368 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1433/2887] 10.222.0.61 () {60 vars in 1483 bytes} [Tue Aug 23 16:43:05 2022] PUT /identity/v3/projects/8a2636e064614a3c939069ecf4f02bd6/users/be29b551676a4137b2f428f190860bd8/roles/896aa4932a1a46dabc0e1036ad2f44de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:43:08.976541 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ab78-cdfd-43f0-b4d8-9461f8e55911 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:08.991026 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430ab78-cdfd-43f0-b4d8-9461f8e55911 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:09.105632 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:09.106506 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:09.106790 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:09.107061 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] PATH_INFO: `/v3/users/834b013cefda41b7bde80c4b1b358841` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:09.108394 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=834b013cefda41b7bde80c4b1b358841)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:09.110384 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:09.302565 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834b013cefda41b7bde80c4b1b358841'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:09.303253 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834b013cefda41b7bde80c4b1b358841'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:09.303891 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834b013cefda41b7bde80c4b1b358841'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:09.308288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:09.371515 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834b013cefda41b7bde80c4b1b358841'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:09.386372 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834b013cefda41b7bde80c4b1b358841'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:09.411191 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1455/2888] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:43:08 2022] DELETE /identity/v3/users/834b013cefda41b7bde80c4b1b358841 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:43:09.416292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750df341-5739-4613-bedf-eb096ca05835 None None] REQUEST_METHOD: `POST` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:09.416807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750df341-5739-4613-bedf-eb096ca05835 None None] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:09.416923 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750df341-5739-4613-bedf-eb096ca05835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:09.441695 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.auth.core [None req-750df341-5739-4613-bedf-eb096ca05835 None None] MFA Rules not processed for user `7d0d465dd7b044aba7e2c5ee9fdc6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81509) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:09.443138 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-750df341-5739-4613-bedf-eb096ca05835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:09.448354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:09.508602 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1434/2889] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:09.521429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:09.523032 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:09.608579 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165934-d93a-40dc-9000-02cb5755a30e admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:09.612553 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac75e69-7e0b-4282-bf45-e03cf0b7dbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:09.613272 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac75e69-7e0b-4282-bf45-e03cf0b7dbad service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:09.613622 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac75e69-7e0b-4282-bf45-e03cf0b7dbad service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:09.613964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac75e69-7e0b-4282-bf45-e03cf0b7dbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:09.624499 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac75e69-7e0b-4282-bf45-e03cf0b7dbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:09.626348 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac75e69-7e0b-4282-bf45-e03cf0b7dbad service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:09.639285 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1456/2890] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:43:10.257191 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750df341-5739-4613-bedf-eb096ca05835 None None] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:10.258685 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-750df341-5739-4613-bedf-eb096ca05835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:10.284327 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750df341-5739-4613-bedf-eb096ca05835 None None] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:10.286230 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:10.292813 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:10.293022 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:10.293303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] PATH_INFO: `/v3/projects/e739f7965f71483e82a394779d99b8d1` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:10.294840 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e739f7965f71483e82a394779d99b8d1)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:10.296942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:10.422216 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e739f7965f71483e82a394779d99b8d1', 'request_id': 'req-c174fb70-a9fb-4695-ae11-208c8f085302'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:10.515619 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e739f7965f71483e82a394779d99b8d1', 'request_id': 'req-c174fb70-a9fb-4695-ae11-208c8f085302'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:10.523686 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e739f7965f71483e82a394779d99b8d1', 'request_id': 'req-c174fb70-a9fb-4695-ae11-208c8f085302'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:10.537811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] The token cache is being invalidate because project e739f7965f71483e82a394779d99b8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81509) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:43:10.538106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:10.538770 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:43:10.540372 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1435/2891] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:43:10 2022] DELETE /identity/v3/projects/e739f7965f71483e82a394779d99b8d1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:43:11.092089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a761-d7ad-434c-9847-29965157159b None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:11.092089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a761-d7ad-434c-9847-29965157159b None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:11.092089 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a761-d7ad-434c-9847-29965157159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:11.121057 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-36f0a761-d7ad-434c-9847-29965157159b None None] MFA Rules not processed for user `be29b551676a4137b2f428f190860bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:11.122603 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-36f0a761-d7ad-434c-9847-29965157159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:11.205578 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1457/2892] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:11.223059 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:11.224521 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:11.339730 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:11.342502 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174fb70-a9fb-4695-ae11-208c8f085302 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:11.348215 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:11.348898 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:11.349184 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:11.349437 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:11.351469 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:11.429284 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:11.431470 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:11.440866 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1436/2893] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:43:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:43:13.975037 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71febc04-cb99-4864-bdff-c9a3d8b95bcc None None] REQUEST_METHOD: `POST` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:13.975588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71febc04-cb99-4864-bdff-c9a3d8b95bcc None None] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:13.975588 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71febc04-cb99-4864-bdff-c9a3d8b95bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:13.994826 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.auth.core [None req-71febc04-cb99-4864-bdff-c9a3d8b95bcc None None] MFA Rules not processed for user `0724c1d3b38c47d881fa27dc3937ca8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:43:13.997862 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-71febc04-cb99-4864-bdff-c9a3d8b95bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:14.004128 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1458/2894] 10.222.0.61 () {58 vars in 958 bytes} [Tue Aug 23 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:43:21.469041 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=26 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:23.989995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=75,keystone:DELETE=2 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:28.906547 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:28.908783 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:29.001008 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a6761-00a9-4627-99f3-648cb648678a service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:29.009943 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:29.010640 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:29.010998 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:29.011280 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:29.013040 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:29.026019 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:29.028568 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:29.040760 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1437/2895] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:43:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:43:39.036508 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=41 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:40.370608 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71febc04-cb99-4864-bdff-c9a3d8b95bcc None None] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:43:40.371995 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-71febc04-cb99-4864-bdff-c9a3d8b95bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:43:40.427776 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71febc04-cb99-4864-bdff-c9a3d8b95bcc None None] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:43:40.431424 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:43:40.432022 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:43:40.432310 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:43:40.432582 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:43:40.441333 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:43:40.442798 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:43:40.452637 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1459/2896] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:43:50.448490 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=26 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:34.565410 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:34.575234 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c0639-9dcd-418f-b994-8c0aecd38a7d service placement] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:34.578708 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:34.579292 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:34.579573 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:34.579841 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:34.581526 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:34.590736 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:34.592154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:34.600030 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1438/2897] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:45:37.957976 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:37.959478 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:37.971146 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98198166-ff1e-49b4-82d2-0932a81f487a service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:37.974791 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:37.975418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:37.975701 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:37.975977 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:37.977699 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:37.991278 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:37.995974 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:38.004288 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1460/2898] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:45:39.182807 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:39.191315 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2bcce-6ea8-4d53-9242-cf4c9aabc053 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:39.194811 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:39.195393 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:39.195671 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:39.195942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:39.197622 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:39.211324 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:39.212731 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:39.224106 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1439/2899] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:45:47.998805 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=6 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:49.218814 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=12 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:52.809631 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:52.818438 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118be0bc-2b42-48af-ab73-98bf63669539 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:52.822591 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:52.823186 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:52.823469 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:52.823736 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:52.825429 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:52.835782 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:52.837213 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:52.845706 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1461/2900] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:45:53.945465 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:53.954156 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d848145-6093-4b85-b3b3-e54870f12e9d service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:53.957787 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d5b15e9f0414836b3611a8ff6085b80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:53.958384 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:53.958665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:53.958937 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:53.961154 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:53.975058 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:53.977076 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:53.988322 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1440/2901] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:45:54.080269 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:54.081713 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:54.096639 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8577a-f942-4084-b8e9-1e72a77f3c31 service neutron] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:54.102080 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:54.102675 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:54.102956 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:54.103228 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:54.104970 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:54.116647 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:54.118270 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:54.128117 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1462/2902] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:45:54.856938 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:45:54.858498 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:54.872576 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb4e44-3f15-4ef7-aefa-f82ed25a42a1 service neutron] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:45:54.878164 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:45:54.878757 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:45:54.879033 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:45:54.879303 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:45:54.880964 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:45:54.893524 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:45:54.895241 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:45:54.906525 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1441/2903] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:46:04.123847 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=12 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:04.901481 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=12 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:17.699834 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:47:17.712808 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17e1fa-327e-488e-b19e-5524a10cabef service placement] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:47:17.718710 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:47:17.719319 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:47:17.719600 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:47:17.720386 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:47:17.721673 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:47:17.735932 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:47:17.737697 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:47:17.750011 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1463/2904] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:47:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:47:20.272323 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:47:20.283486 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02375a9-de64-4084-862e-946d124ab992 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:47:20.289660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ac116b19864bd694ca089dd5f7e010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:47:20.290248 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:47:20.290528 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:47:20.290799 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:47:20.292472 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:47:20.304942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:47:20.306533 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:47:20.316839 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1442/2905] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:47:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:47:26.754745 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:47:26.766654 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58c7ee-aab2-4678-98a2-888f6aead9da service nova] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:47:26.771703 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:47:26.772915 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] REQUEST_METHOD: `GET` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:47:26.773261 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:47:26.773602 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:47:26.781696 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:47:26.794369 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:47:26.795964 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:47:26.805841 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1464/2906] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:47:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:47:30.312421 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=6 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:30.652084 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:47:30.653723 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:47:30.717962 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2f88d-ae5d-4329-8c6f-1ba553b7e851 service nova] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:47:30.722793 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:47:30.723428 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:47:30.723710 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:47:30.723981 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] PATH_INFO: `/v3/users/0724c1d3b38c47d881fa27dc3937ca8c` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:47:30.725094 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0724c1d3b38c47d881fa27dc3937ca8c)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:47:30.727073 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:47:31.065442 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0724c1d3b38c47d881fa27dc3937ca8c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.073007 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0724c1d3b38c47d881fa27dc3937ca8c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.073719 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0724c1d3b38c47d881fa27dc3937ca8c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.074334 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0724c1d3b38c47d881fa27dc3937ca8c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.086578 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0724c1d3b38c47d881fa27dc3937ca8c'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.204910 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1443/2907] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:47:30 2022] DELETE /identity/v3/users/0724c1d3b38c47d881fa27dc3937ca8c => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:47:31.475216 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:47:31.481843 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cc4e6-1cc8-4228-9d65-3cd5ee757caa service placement] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:47:31.540641 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:47:31.541259 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:47:31.541537 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:47:31.541839 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] PATH_INFO: `/v3/projects/3545dec5afb04144bfcdf9919a9f7747` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:47:31.542939 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3545dec5afb04144bfcdf9919a9f7747)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:47:31.544830 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:47:31.662327 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3545dec5afb04144bfcdf9919a9f7747', 'request_id': 'req-8e52f232-85cc-41b3-9692-b3f884a68db4'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.669042 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3545dec5afb04144bfcdf9919a9f7747', 'request_id': 'req-8e52f232-85cc-41b3-9692-b3f884a68db4'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.770969 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3545dec5afb04144bfcdf9919a9f7747', 'request_id': 'req-8e52f232-85cc-41b3-9692-b3f884a68db4'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.782266 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] The token cache is being invalidate because project 3545dec5afb04144bfcdf9919a9f7747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:47:31.782596 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.790200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:31.790200 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1465/2908] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:47:31 2022] DELETE /identity/v3/projects/3545dec5afb04144bfcdf9919a9f7747 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:47:31.790520 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:47:31.791195 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:47:31.804045 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9842bd6-48ba-451c-ab0f-14810c3f959d admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:47:31.861826 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:47:31.862454 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:47:31.862734 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:47:31.863003 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] PATH_INFO: `/v3/users/be29b551676a4137b2f428f190860bd8` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:47:31.864134 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be29b551676a4137b2f428f190860bd8)` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:47:31.866065 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:47:31.890229 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:32.129265 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be29b551676a4137b2f428f190860bd8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.137769 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be29b551676a4137b2f428f190860bd8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.138683 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be29b551676a4137b2f428f190860bd8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.139231 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be29b551676a4137b2f428f190860bd8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.152652 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.notifications [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be29b551676a4137b2f428f190860bd8'} {{(pid=81509) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.234021 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1444/2909] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 16:47:31 2022] DELETE /identity/v3/users/be29b551676a4137b2f428f190860bd8 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:47:32.481459 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] Authenticating user token {{(pid=81508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:47:32.482897 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.fernet_utils [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:47:32.498638 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52f232-85cc-41b3-9692-b3f884a68db4 admin admin] Validating token access rules against request {{(pid=81508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:47:32.558143 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d0d465dd7b044aba7e2c5ee9fdc6c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2a01d2eee64cb9a559a6d537ff97c8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:47:32.558789 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:47:32.559073 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:47:32.559347 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] PATH_INFO: `/v3/projects/8a2636e064614a3c939069ecf4f02bd6` {{(pid=81508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:47:32.560471 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2636e064614a3c939069ecf4f02bd6)` {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:47:32.562418 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] RBAC: Authorization granted {{(pid=81508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:47:32.573564 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:32.748025 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2636e064614a3c939069ecf4f02bd6', 'request_id': 'req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.754255 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2636e064614a3c939069ecf4f02bd6', 'request_id': 'req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.827772 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2636e064614a3c939069ecf4f02bd6', 'request_id': 'req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c'} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.838256 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] The token cache is being invalidate because project 8a2636e064614a3c939069ecf4f02bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:47:32.838544 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.839161 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG keystone.notifications [None req-0fc33ec3-20cb-4f1a-aa79-cf16177e6a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:47:32.840627 dv-cinder-850320-6-smb devstack@keystone.service[81508]: [pid: 81508|app: 0|req: 1466/2910] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 16:47:32 2022] DELETE /identity/v3/projects/8a2636e064614a3c939069ecf4f02bd6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:47:42.230162 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:42.835249 dv-cinder-850320-6-smb devstack@keystone.service[81508]: DEBUG dbcounter [-] [81508] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:30.854870 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] Authenticating user token {{(pid=81509) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:48:30.856389 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:48:30.927643 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf48e8-1c45-46ff-8cf4-6b6e746726e5 admin admin] Validating token access rules against request {{(pid=81509) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:48:30.987747 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bbddf-38dc-4803-ae60-30b3e3f7cb69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4aea4da0e5e342a39974c08bf69518e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c90205ba53c4412a86dce8c2103ea7a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81509) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:48:30.988354 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbddf-38dc-4803-ae60-30b3e3f7cb69 service placement] REQUEST_METHOD: `GET` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:48:30.988638 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbddf-38dc-4803-ae60-30b3e3f7cb69 service placement] SCRIPT_NAME: `/identity` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:48:30.988911 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbddf-38dc-4803-ae60-30b3e3f7cb69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81509) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:48:30.990665 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.fernet_utils [None req-c82bbddf-38dc-4803-ae60-30b3e3f7cb69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81509) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:48:31.001691 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bbddf-38dc-4803-ae60-30b3e3f7cb69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:48:31.003825 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bbddf-38dc-4803-ae60-30b3e3f7cb69 service placement] RBAC: Authorization granted {{(pid=81509) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:48:31.013942 dv-cinder-850320-6-smb devstack@keystone.service[81509]: [pid: 81509|app: 0|req: 1445/2911] 10.222.0.61 () {60 vars in 1365 bytes} [Tue Aug 23 16:48:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:48:41.009660 dv-cinder-850320-6-smb devstack@keystone.service[81509]: DEBUG dbcounter [-] [81509] Writing DB stats keystone:SELECT=58 {{(pid=81509) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}